2024-05-08T10:12:58.846 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T10:12:58.846 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi --archive /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} --owner scheduled_jcollin@teuthology -- /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/orig.config.yaml 2024-05-08T10:12:58.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T10:12:59.346 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400 branch: wip-jcollin-testing-07052024 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} email: jcollin@redhat.com first_in_suite: false job_id: '7697400' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-jcollin-testing-07052024 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: cd693b0b93278c2b128be2d6d93ae4df18c3ba1c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: cd693b0b93278c2b128be2d6d93ae4df18c3ba1c kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: origin-jcollin-testing sha1: 486398014c80883074e0469d9aa7f4ebb8fab0b6 owner: scheduled_jcollin@teuthology priority: 2 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: cd693b0b93278c2b128be2d6d93ae4df18c3ba1c sleep_before_teardown: 0 suite: fs:functional suite_branch: origin-jcollin-testing suite_path: /home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa suite_relpath: qa suite_repo: https://github.com/joscollin/ceph.git suite_sha1: 486398014c80883074e0469d9aa7f4ebb8fab0b6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWJ+hlvCU+RQbiB8D6Z1ZWGpb72LvgWYaQjhbEZDtpE7a7pRiDDzNH8grax0hvyIE62BmUzBe/CEppoYCNoSeM= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdRH89PE8AUm+BKZpFPskz3c4EU7ry/ujdoPhzopSXLxvYCUpu/Sa8LOD1f4/eaGfFZdzoFdexE5wuWK8cEA2k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_flush teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_10:01:15 tube: smithi user: jcollin verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T10:12:59.346 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa; will attempt to use it 2024-05-08T10:12:59.347 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks 2024-05-08T10:12:59.347 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T10:12:59.349 INFO:teuthology.task.internal:Checking packages... 2024-05-08T10:12:59.377 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c' 2024-05-08T10:12:59.377 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T10:12:59.377 INFO:teuthology.packaging:ref: None 2024-05-08T10:12:59.377 INFO:teuthology.packaging:tag: None 2024-05-08T10:12:59.377 INFO:teuthology.packaging:branch: wip-jcollin-testing-07052024 2024-05-08T10:12:59.377 INFO:teuthology.packaging:sha1: cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-08T10:12:59.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-jcollin-testing-07052024 2024-05-08T10:12:59.515 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3538.gcd693b0b 2024-05-08T10:12:59.516 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T10:12:59.522 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T10:12:59.522 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T10:12:59.533 INFO:teuthology.task.internal:Saving configuration 2024-05-08T10:12:59.551 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T10:12:59.556 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T10:12:59.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 10:07:11.519233', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWJ+hlvCU+RQbiB8D6Z1ZWGpb72LvgWYaQjhbEZDtpE7a7pRiDDzNH8grax0hvyIE62BmUzBe/CEppoYCNoSeM='} 2024-05-08T10:12:59.603 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 10:07:11.521082', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdRH89PE8AUm+BKZpFPskz3c4EU7ry/ujdoPhzopSXLxvYCUpu/Sa8LOD1f4/eaGfFZdzoFdexE5wuWK8cEA2k='} 2024-05-08T10:12:59.603 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T10:12:59.609 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-08T10:12:59.609 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-08T10:12:59.609 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T10:12:59.679 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3c9ecb1160>, signals=[15]) 2024-05-08T10:12:59.679 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T10:12:59.685 INFO:teuthology.task.internal:Opening connections... 2024-05-08T10:12:59.685 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:12:59.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:12:59.762 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:12:59.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:12:59.838 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T10:12:59.845 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-05-08T10:12:59.862 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-05-08T10:12:59.862 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-05-08T10:12:59.918 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-05-08T10:12:59.918 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-05-08T10:12:59.918 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-05-08T10:12:59.918 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-05-08T10:12:59.918 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-05-08T10:12:59.918 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-05-08T10:12:59.919 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T10:12:59.919 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-05-08T10:12:59.919 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-05-08T10:12:59.919 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T10:12:59.919 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-05-08T10:12:59.919 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T10:12:59.919 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T10:12:59.919 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T10:12:59.920 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-05-08T10:12:59.952 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-05-08T10:12:59.970 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-05-08T10:12:59.970 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-05-08T10:13:00.027 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-05-08T10:13:00.027 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T10:13:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T10:13:00.029 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-05-08T10:13:00.052 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T10:13:00.060 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T10:13:00.065 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T10:13:00.066 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-05-08T10:13:00.068 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-05-08T10:13:00.084 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T10:13:00.089 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T10:13:00.090 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-05-08T10:13:00.124 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-05-08T10:13:00.210 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T10:13:00.262 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T10:13:00.277 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-05-08T10:13:00.277 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-05-08T10:13:00.277 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-08T10:13:00.277 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T10:13:00.278 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T10:13:00.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:13:00.294 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-05-08T10:13:00.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:13:00.295 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-05-08T10:13:00.350 INFO:teuthology.orchestra.run.smithi143.stdout:5.14.0-437.el9.x86_64 2024-05-08T10:13:00.350 INFO:teuthology.task.kernel:Running kernel on smithi143: 5.14.0-437.el9.x86_64 2024-05-08T10:13:00.350 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum install -y kernel 2024-05-08T10:13:00.352 INFO:teuthology.orchestra.run.smithi163.stdout:5.14.0-437.el9.x86_64 2024-05-08T10:13:00.352 INFO:teuthology.task.kernel:Running kernel on smithi163: 5.14.0-437.el9.x86_64 2024-05-08T10:13:00.353 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum install -y kernel 2024-05-08T10:13:02.747 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-08T10:13:06.225 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.1 MB 00:04 2024-05-08T10:13:06.350 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 19 MB 00:02 2024-05-08T10:13:08.069 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-08T10:13:10.443 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-08T10:13:11.877 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-05-08T10:13:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.2 MB 00:00 2024-05-08T10:13:13.760 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 16 kB 00:00 2024-05-08T10:13:14.795 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-05-08T10:13:16.770 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 21 MB 00:04 2024-05-08T10:13:19.845 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-08T10:13:21.851 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T10:13:21.852 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T10:13:21.919 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-08T10:13:21.949 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-05-08T10:13:21.958 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-05-08T10:13:21.958 INFO:teuthology.orchestra.run.smithi163.stdout: Package Architecture Version Repository Size 2024-05-08T10:13:21.958 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-05-08T10:13:21.958 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-05-08T10:13:21.958 INFO:teuthology.orchestra.run.smithi163.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T10:13:21.958 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-05-08T10:13:21.958 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T10:13:21.958 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T10:13:21.959 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T10:13:21.959 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:13:21.959 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-05-08T10:13:21.959 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-05-08T10:13:21.959 INFO:teuthology.orchestra.run.smithi163.stdout:Install 4 Packages 2024-05-08T10:13:21.959 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:13:21.959 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 78 M 2024-05-08T10:13:21.960 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 123 M 2024-05-08T10:13:21.960 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-05-08T10:13:22.125 INFO:teuthology.orchestra.run.smithi143.stdout:Last metadata expiration check: 0:00:01 ago on Wed 08 May 2024 10:13:21 AM UTC. 2024-05-08T10:13:22.255 INFO:teuthology.orchestra.run.smithi163.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.8 MB/s | 484 kB 00:00 2024-05-08T10:13:22.688 INFO:teuthology.orchestra.run.smithi163.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 26 MB/s | 15 MB 00:00 2024-05-08T10:13:22.938 INFO:teuthology.orchestra.run.smithi163.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 41 MB/s | 28 MB 00:00 2024-05-08T10:13:23.380 INFO:teuthology.orchestra.run.smithi163.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 26 MB/s | 34 MB 00:01 2024-05-08T10:13:23.381 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-05-08T10:13:23.381 INFO:teuthology.orchestra.run.smithi163.stdout:Total 55 MB/s | 78 MB 00:01 2024-05-08T10:13:23.934 INFO:teuthology.orchestra.run.smithi143.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T10:13:23.934 INFO:teuthology.orchestra.run.smithi143.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T10:13:24.036 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-05-08T10:13:24.049 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-05-08T10:13:24.049 INFO:teuthology.orchestra.run.smithi143.stdout: Package Architecture Version Repository Size 2024-05-08T10:13:24.049 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-05-08T10:13:24.049 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-05-08T10:13:24.049 INFO:teuthology.orchestra.run.smithi143.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T10:13:24.049 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-05-08T10:13:24.049 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T10:13:24.049 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T10:13:24.050 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T10:13:24.050 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:13:24.050 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-05-08T10:13:24.050 INFO:teuthology.orchestra.run.smithi143.stdout:================================================================================ 2024-05-08T10:13:24.050 INFO:teuthology.orchestra.run.smithi143.stdout:Install 4 Packages 2024-05-08T10:13:24.050 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:13:24.050 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 78 M 2024-05-08T10:13:24.051 INFO:teuthology.orchestra.run.smithi143.stdout:Installed size: 123 M 2024-05-08T10:13:24.051 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-05-08T10:13:24.069 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-05-08T10:13:24.432 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-05-08T10:13:24.433 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-05-08T10:13:24.471 INFO:teuthology.orchestra.run.smithi143.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 1.6 MB/s | 484 kB 00:00 2024-05-08T10:13:25.379 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-05-08T10:13:25.379 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-05-08T10:13:27.704 INFO:teuthology.orchestra.run.smithi143.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 4.4 MB/s | 15 MB 00:03 2024-05-08T10:13:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-05-08T10:13:28.422 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T10:13:28.513 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:13:29.821 INFO:teuthology.orchestra.run.smithi143.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 6.0 MB/s | 34 MB 00:05 2024-05-08T10:13:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:13:31.357 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:13:32.604 INFO:teuthology.orchestra.run.smithi143.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 3.4 MB/s | 28 MB 00:08 2024-05-08T10:13:32.604 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-05-08T10:13:32.605 INFO:teuthology.orchestra.run.smithi143.stdout:Total 9.1 MB/s | 78 MB 00:08 2024-05-08T10:13:33.286 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-05-08T10:13:33.632 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-05-08T10:13:33.632 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-05-08T10:13:34.555 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-05-08T10:13:34.556 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-05-08T10:13:36.071 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:13:36.126 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:13:36.965 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-05-08T10:13:37.614 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T10:13:37.706 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:13:40.379 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:13:40.543 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:13:40.894 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:13:45.250 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:13:45.354 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:13:50.098 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:14:10.468 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:14:10.507 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:14:10.845 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:14:10.845 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T10:14:10.845 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:14:10.846 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:14:11.625 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:14:11.625 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:14:11.625 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-05-08T10:14:11.625 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T10:14:11.625 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T10:14:11.625 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T10:14:11.626 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T10:14:11.626 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:14:11.626 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-05-08T10:14:11.964 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T10:14:12.036 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T10:14:12.036 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T10:14:12.036 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T10:14:12.036 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T10:14:12.036 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T10:14:12.037 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-05-08T10:14:12.037 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T10:14:12.037 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T10:14:12.087 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T10:14:12.087 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T10:14:12.087 DEBUG:teuthology.orchestra.run.smithi163:> sudo rpm -qi grub2-tools 2024-05-08T10:14:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:Name : grub2-tools 2024-05-08T10:14:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:Epoch : 1 2024-05-08T10:14:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:Version : 2.06 2024-05-08T10:14:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:Release : 68.el9 2024-05-08T10:14:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: x86_64 2024-05-08T10:14:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T10:14:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:Group : Unspecified 2024-05-08T10:14:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:Size : 8264254 2024-05-08T10:14:12.128 INFO:teuthology.orchestra.run.smithi163.stdout:License : GPLv3+ 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:Packager : builder@centos.org 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:Vendor : CentOS 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:Summary : Support tools for GRUB. 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:Description : 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T10:14:12.129 INFO:teuthology.orchestra.run.smithi163.stdout:hardware devices. 2024-05-08T10:14:12.130 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:14:12.130 INFO:teuthology.orchestra.run.smithi163.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T10:14:12.130 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T10:14:12.131 INFO:teuthology.task.kernel:Updating grub on smithi163 to boot 5.14.0-444.el9.x86_64 2024-05-08T10:14:12.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T10:14:12.705 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2024-05-08T10:14:14.129 INFO:teuthology.orchestra.run.smithi163.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T10:14:14.163 INFO:teuthology.orchestra.run.smithi163.stderr:done 2024-05-08T10:14:14.165 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-05-08T10:14:14.180 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.4z7MuBqx5R 2024-05-08T10:14:14.181 DEBUG:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4z7MuBqx5R 2024-05-08T10:14:14.247 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.4z7MuBqx5R 2024-05-08T10:14:14.385 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.4z7MuBqx5R is 6KB 2024-05-08T10:14:14.435 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.4z7MuBqx5R 2024-05-08T10:14:14.449 DEBUG:teuthology.orchestra.run.smithi163:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T10:14:14.514 INFO:teuthology.orchestra.run.smithi163.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T10:14:14.515 INFO:teuthology.orchestra.run.smithi163.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T10:14:14.515 INFO:teuthology.orchestra.run.smithi163.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T10:14:14.515 INFO:teuthology.orchestra.run.smithi163.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T10:14:14.516 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T10:14:14.670 DEBUG:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2024-05-08T10:14:19.314 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:14:19.353 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:14:19.647 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:14:19.647 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T10:14:19.647 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:14:19.647 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:14:20.429 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:14:20.429 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:14:20.429 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-05-08T10:14:20.429 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T10:14:20.429 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T10:14:20.429 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T10:14:20.429 INFO:teuthology.orchestra.run.smithi143.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T10:14:20.429 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:14:20.429 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-05-08T10:14:20.788 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T10:14:20.862 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T10:14:20.863 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T10:14:20.863 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T10:14:20.863 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T10:14:20.863 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T10:14:20.863 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-08T10:14:20.863 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi143.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T10:14:20.863 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T10:14:20.913 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T10:14:20.913 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T10:14:20.913 DEBUG:teuthology.orchestra.run.smithi143:> sudo rpm -qi grub2-tools 2024-05-08T10:14:20.944 INFO:teuthology.orchestra.run.smithi143.stdout:Name : grub2-tools 2024-05-08T10:14:20.944 INFO:teuthology.orchestra.run.smithi143.stdout:Epoch : 1 2024-05-08T10:14:20.944 INFO:teuthology.orchestra.run.smithi143.stdout:Version : 2.06 2024-05-08T10:14:20.944 INFO:teuthology.orchestra.run.smithi143.stdout:Release : 68.el9 2024-05-08T10:14:20.944 INFO:teuthology.orchestra.run.smithi143.stdout:Architecture: x86_64 2024-05-08T10:14:20.944 INFO:teuthology.orchestra.run.smithi143.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T10:14:20.944 INFO:teuthology.orchestra.run.smithi143.stdout:Group : Unspecified 2024-05-08T10:14:20.944 INFO:teuthology.orchestra.run.smithi143.stdout:Size : 8264254 2024-05-08T10:14:20.944 INFO:teuthology.orchestra.run.smithi143.stdout:License : GPLv3+ 2024-05-08T10:14:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T10:14:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T10:14:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T10:14:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T10:14:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:Packager : builder@centos.org 2024-05-08T10:14:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:Vendor : CentOS 2024-05-08T10:14:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T10:14:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:Summary : Support tools for GRUB. 2024-05-08T10:14:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:Description : 2024-05-08T10:14:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:14:20.946 INFO:teuthology.orchestra.run.smithi143.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T10:14:20.946 INFO:teuthology.orchestra.run.smithi143.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T10:14:20.946 INFO:teuthology.orchestra.run.smithi143.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T10:14:20.946 INFO:teuthology.orchestra.run.smithi143.stdout:hardware devices. 2024-05-08T10:14:20.946 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:14:20.946 INFO:teuthology.orchestra.run.smithi143.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T10:14:20.947 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T10:14:20.947 INFO:teuthology.task.kernel:Updating grub on smithi143 to boot 5.14.0-444.el9.x86_64 2024-05-08T10:14:20.947 DEBUG:teuthology.orchestra.run.smithi143:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T10:14:21.587 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2024-05-08T10:14:22.933 INFO:teuthology.orchestra.run.smithi143.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T10:14:22.966 INFO:teuthology.orchestra.run.smithi143.stderr:done 2024-05-08T10:14:22.968 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-05-08T10:14:22.984 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.Nf1Bca7JLp 2024-05-08T10:14:22.984 DEBUG:teuthology.orchestra.run.smithi143:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Nf1Bca7JLp 2024-05-08T10:14:23.050 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.Nf1Bca7JLp 2024-05-08T10:14:23.191 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.Nf1Bca7JLp is 6KB 2024-05-08T10:14:23.239 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.Nf1Bca7JLp 2024-05-08T10:14:23.253 DEBUG:teuthology.orchestra.run.smithi143:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T10:14:23.314 INFO:teuthology.orchestra.run.smithi143.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T10:14:23.314 INFO:teuthology.orchestra.run.smithi143.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T10:14:23.314 INFO:teuthology.orchestra.run.smithi143.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T10:14:23.314 INFO:teuthology.orchestra.run.smithi143.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T10:14:23.316 DEBUG:teuthology.orchestra.run.smithi143:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T10:14:23.444 DEBUG:teuthology.orchestra.run.smithi143:> sudo shutdown -r now 2024-05-08T10:14:44.685 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-08T10:14:44.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-08T10:14:44.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:14:53.458 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-08T10:14:53.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-05-08T10:14:53.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:15:19.326 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-05-08T10:15:28.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-08T10:15:28.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:15:31.390 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-05-08T10:15:43.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-08T10:15:43.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:15:53.472 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T10:16:02.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-05-08T10:16:02.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:16:02.785 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-05-08T10:16:03.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-05-08T10:16:03.306 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-08T10:16:03.306 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-05-08T10:16:03.321 INFO:teuthology.orchestra.run.smithi143.stdout:5.14.0-444.el9.x86_64 2024-05-08T10:16:03.321 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T10:16:03.321 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T10:16:03.321 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T10:16:04.322 DEBUG:teuthology.parallel:result is None 2024-05-08T10:16:43.404 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T10:16:58.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-08T10:16:58.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:16:58.830 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-05-08T10:16:59.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-08T10:16:59.217 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-444.el9.x86_64"... 2024-05-08T10:16:59.217 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-05-08T10:16:59.233 INFO:teuthology.orchestra.run.smithi163.stdout:5.14.0-444.el9.x86_64 2024-05-08T10:16:59.233 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T10:16:59.234 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T10:16:59.234 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T10:17:00.235 DEBUG:teuthology.parallel:result is None 2024-05-08T10:17:00.235 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T10:17:00.243 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T10:17:00.243 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T10:17:00.247 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T10:17:00.265 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T10:17:00.271 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T10:17:00.282 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T10:17:00.282 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T10:17:00.306 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T10:17:00.457 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T10:17:00.464 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T10:17:00.464 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T10:17:00.467 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T10:17:00.533 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T10:17:00.550 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T10:17:00.581 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T10:17:00.591 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T10:17:00.593 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T10:17:00.600 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T10:17:00.600 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T10:17:00.603 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T10:17:00.630 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T10:17:00.639 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T10:17:00.639 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T10:17:00.671 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T10:17:00.688 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T10:17:00.772 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T10:17:00.819 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T10:17:00.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T10:17:00.944 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:17:00.944 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T10:17:01.010 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T10:17:01.052 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T10:17:01.116 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T10:17:01.160 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T10:17:01.198 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:17:01.199 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T10:17:01.264 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-05-08T10:17:01.266 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2024-05-08T10:17:01.311 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T10:17:01.338 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T10:17:01.653 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T10:17:01.660 INFO:teuthology.task.internal:Starting timer... 2024-05-08T10:17:01.660 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T10:17:01.676 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T10:17:01.684 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-08T10:17:01.685 DEBUG:teuthology.orchestra.run.smithi143:> sudo service auditd rotate 2024-05-08T10:17:01.760 INFO:teuthology.orchestra.run.smithi143.stdout:Rotating logs: 2024-05-08T10:17:01.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2024-05-08T10:17:01.817 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2024-05-08T10:17:01.818 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T10:17:01.819 DEBUG:teuthology.orchestra.run.smithi143:> /usr/sbin/getenforce 2024-05-08T10:17:01.841 INFO:teuthology.orchestra.run.smithi143.stdout:Permissive 2024-05-08T10:17:01.841 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2024-05-08T10:17:01.863 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2024-05-08T10:17:01.864 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi143.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi163.front.sepia.ceph.com': 'permissive'} 2024-05-08T10:17:01.864 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T10:17:01.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:17:01.908 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T10:17:01.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:17:01.934 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T10:17:01.934 DEBUG:teuthology.orchestra.run.smithi143:> sudo /usr/sbin/setenforce permissive 2024-05-08T10:17:01.986 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2024-05-08T10:17:02.012 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T10:17:02.022 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T10:17:02.040 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T10:17:02.042 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi143.front.sepia.ceph.com,smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T10:21:00.135 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi143.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2024-05-08T10:21:00.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-05-08T10:21:00.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:21:00.220 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-05-08T10:21:00.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-05-08T10:21:00.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-08T10:21:00.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:21:00.380 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-05-08T10:21:00.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-05-08T10:21:00.461 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T10:21:00.475 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T10:21:00.476 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T10:21:00.476 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T10:21:00.479 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T10:21:00.479 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T10:21:00.508 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T10:21:00.523 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T10:21:00.531 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T10:21:00.545 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T10:21:00.548 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: ntpd: command not found 2024-05-08T10:21:00.559 INFO:teuthology.orchestra.run.smithi143.stdout:506 Cannot talk to daemon 2024-05-08T10:21:00.569 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2024-05-08T10:21:00.573 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T10:21:00.580 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2024-05-08T10:21:00.587 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T10:21:00.594 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T10:21:00.608 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T10:21:00.642 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-05-08T10:21:00.646 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T10:21:00.646 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-05-08T10:21:00.646 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:21:00.646 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:21:00.646 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:21:00.646 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:21:00.661 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-05-08T10:21:00.664 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T10:21:00.664 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-05-08T10:21:00.665 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:21:00.665 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:21:00.665 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:21:00.665 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:21:00.665 INFO:teuthology.run_tasks:Running task install... 2024-05-08T10:21:00.675 DEBUG:teuthology.task.install:project ceph 2024-05-08T10:21:00.675 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'}} 2024-05-08T10:21:00.675 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'} 2024-05-08T10:21:00.675 INFO:teuthology.task.install:Using flavor: default 2024-05-08T10:21:00.681 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T10:21:00.681 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T10:21:00.682 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c', 'tag': None, 'wait_for_package': False} 2024-05-08T10:21:00.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-08T10:21:00.684 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c', 'tag': None, 'wait_for_package': False} 2024-05-08T10:21:00.685 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-08T10:21:00.906 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/ 2024-05-08T10:21:00.907 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gcd693b0b 2024-05-08T10:21:00.914 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/ 2024-05-08T10:21:00.914 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gcd693b0b 2024-05-08T10:21:01.030 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T10:21:01.030 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:21:01.030 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T10:21:01.056 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T10:21:01.056 DEBUG:teuthology.orchestra.run.smithi143:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T10:21:01.123 DEBUG:teuthology.orchestra.run.smithi143:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T10:21:01.198 DEBUG:teuthology.orchestra.run.smithi143:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T10:21:01.263 INFO:teuthology.orchestra.run.smithi143.stdout:check_obsoletes = 1 2024-05-08T10:21:01.265 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum clean all 2024-05-08T10:21:01.490 INFO:teuthology.orchestra.run.smithi143.stdout:54 files removed 2024-05-08T10:21:01.516 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T10:21:02.090 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T10:21:02.091 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:21:02.091 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T10:21:02.122 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T10:21:02.123 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T10:21:02.192 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T10:21:02.272 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T10:21:02.304 INFO:teuthology.orchestra.run.smithi143.stdout:ceph packages for x86_64 164 kB/s | 84 kB 00:00 2024-05-08T10:21:02.339 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2024-05-08T10:21:02.341 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2024-05-08T10:21:02.579 INFO:teuthology.orchestra.run.smithi163.stdout:54 files removed 2024-05-08T10:21:02.606 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T10:21:02.704 INFO:teuthology.orchestra.run.smithi143.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-05-08T10:21:03.313 INFO:teuthology.orchestra.run.smithi143.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-05-08T10:21:03.379 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 168 kB/s | 84 kB 00:00 2024-05-08T10:21:03.770 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-05-08T10:21:04.172 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.1 MB 00:00 2024-05-08T10:21:06.730 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 665 B/s | 1.9 kB 00:02 2024-05-08T10:21:07.106 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-05-08T10:21:07.363 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-08T10:21:09.255 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-05-08T10:21:12.099 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.2 MB 00:01 2024-05-08T10:21:13.389 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-08T10:21:13.708 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 16 kB 00:00 2024-05-08T10:21:14.774 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 16 kB 00:00 2024-05-08T10:21:15.838 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-08T10:21:16.792 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-08T10:21:21.102 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-05-08T10:21:21.992 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-08T10:21:23.479 INFO:teuthology.orchestra.run.smithi143.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T10:21:23.479 INFO:teuthology.orchestra.run.smithi143.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T10:21:23.490 INFO:teuthology.orchestra.run.smithi143.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T10:21:23.490 INFO:teuthology.orchestra.run.smithi143.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T10:21:23.491 INFO:teuthology.orchestra.run.smithi143.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T10:21:23.492 INFO:teuthology.orchestra.run.smithi143.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T10:21:23.494 INFO:teuthology.orchestra.run.smithi143.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T10:21:23.496 INFO:teuthology.orchestra.run.smithi143.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T10:21:23.497 INFO:teuthology.orchestra.run.smithi143.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T10:21:23.558 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-05-08T10:21:23.580 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-05-08T10:21:23.580 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-05-08T10:21:23.580 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-05-08T10:21:23.580 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-05-08T10:21:23.580 INFO:teuthology.orchestra.run.smithi143.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 6.6 k 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 5.4 M 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 891 k 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 145 k 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 1.5 M 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 142 k 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 3.5 M 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 7.4 M 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 49 k 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 11 M 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 49 M 2024-05-08T10:21:23.581 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 273 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 764 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 225 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-shell x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 27 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-top noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 18 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 32 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 746 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 127 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T10:21:23.582 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 161 k 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 320 k 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 301 k 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 99 k 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 86 k 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.1 M 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 171 k 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T10:21:23.583 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrading: 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: librados2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.4 M 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.1 M 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T10:21:23.584 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 21 M 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 34 k 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 2.4 M 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 274 k 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 4.7 M 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 17 M 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 16 k 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 25 k 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T10:21:23.585 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 163 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 500 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 5.4 M 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T10:21:23.586 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T10:21:23.587 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 45 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 135 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T10:21:23.588 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T10:21:23.589 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T10:21:23.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T10:21:23.591 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T10:21:23.592 INFO:teuthology.orchestra.run.smithi143.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout:Installing weak dependencies: 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout:Install 148 Packages 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrade 8 Packages 2024-05-08T10:21:23.593 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:21:23.594 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 226 M 2024-05-08T10:21:23.594 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-05-08T10:21:24.212 INFO:teuthology.orchestra.run.smithi143.stdout:(1/156): ceph-19.0.0-3538.gcd693b0b.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-05-08T10:21:24.335 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T10:21:24.336 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T10:21:24.348 INFO:teuthology.orchestra.run.smithi163.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T10:21:24.348 INFO:teuthology.orchestra.run.smithi163.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T10:21:24.349 INFO:teuthology.orchestra.run.smithi163.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T10:21:24.350 INFO:teuthology.orchestra.run.smithi163.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T10:21:24.352 INFO:teuthology.orchestra.run.smithi163.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T10:21:24.354 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T10:21:24.355 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T10:21:24.416 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-05-08T10:21:24.436 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================= 2024-05-08T10:21:24.436 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-05-08T10:21:24.436 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================= 2024-05-08T10:21:24.436 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 6.6 k 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 5.4 M 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 891 k 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 145 k 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 1.5 M 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 142 k 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 3.5 M 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 7.4 M 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 49 k 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 11 M 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 49 M 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 273 k 2024-05-08T10:21:24.437 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 764 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 225 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-shell x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 27 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 18 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 32 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 746 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 127 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T10:21:24.438 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 161 k 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 320 k 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 301 k 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 99 k 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 86 k 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.1 M 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 171 k 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T10:21:24.439 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.4 M 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.1 M 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 21 M 2024-05-08T10:21:24.440 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 34 k 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 2.4 M 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 274 k 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 4.7 M 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 17 M 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 16 k 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 25 k 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T10:21:24.441 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 163 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 500 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 5.4 M 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T10:21:24.442 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T10:21:24.443 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 45 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 135 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T10:21:24.444 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T10:21:24.445 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T10:21:24.446 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T10:21:24.447 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T10:21:24.448 INFO:teuthology.orchestra.run.smithi163.stdout:Installing weak dependencies: 2024-05-08T10:21:24.449 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T10:21:24.449 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:21:24.449 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-05-08T10:21:24.449 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================= 2024-05-08T10:21:24.449 INFO:teuthology.orchestra.run.smithi163.stdout:Install 148 Packages 2024-05-08T10:21:24.449 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 8 Packages 2024-05-08T10:21:24.449 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:21:24.450 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 226 M 2024-05-08T10:21:24.450 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-05-08T10:21:24.521 INFO:teuthology.orchestra.run.smithi143.stdout:(2/156): ceph-fuse-19.0.0-3538.gcd693b0b.el9.x8 2.8 MB/s | 891 kB 00:00 2024-05-08T10:21:24.613 INFO:teuthology.orchestra.run.smithi143.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 1.5 MB/s | 145 kB 00:00 2024-05-08T10:21:24.713 INFO:teuthology.orchestra.run.smithi143.stdout:(4/156): ceph-base-19.0.0-3538.gcd693b0b.el9.x8 7.3 MB/s | 5.4 MB 00:00 2024-05-08T10:21:25.005 INFO:teuthology.orchestra.run.smithi143.stdout:(5/156): ceph-mds-19.0.0-3538.gcd693b0b.el9.x86 6.0 MB/s | 2.4 MB 00:00 2024-05-08T10:21:25.088 INFO:teuthology.orchestra.run.smithi143.stdout:(6/156): ceph-mgr-19.0.0-3538.gcd693b0b.el9.x86 4.0 MB/s | 1.5 MB 00:00 2024-05-08T10:21:25.639 INFO:teuthology.orchestra.run.smithi143.stdout:(7/156): ceph-mon-19.0.0-3538.gcd693b0b.el9.x86 7.4 MB/s | 4.7 MB 00:00 2024-05-08T10:21:25.778 INFO:teuthology.orchestra.run.smithi163.stdout:(1/156): ceph-19.0.0-3538.gcd693b0b.el9.x86_64. 8.8 kB/s | 6.6 kB 00:00 2024-05-08T10:21:26.440 INFO:teuthology.orchestra.run.smithi143.stdout:(8/156): ceph-osd-19.0.0-3538.gcd693b0b.el9.x86 12 MB/s | 17 MB 00:01 2024-05-08T10:21:26.443 INFO:teuthology.orchestra.run.smithi163.stdout:(2/156): ceph-fuse-19.0.0-3538.gcd693b0b.el9.x8 1.3 MB/s | 891 kB 00:00 2024-05-08T10:21:26.523 INFO:teuthology.orchestra.run.smithi143.stdout:(9/156): ceph-selinux-19.0.0-3538.gcd693b0b.el9 306 kB/s | 25 kB 00:00 2024-05-08T10:21:26.535 INFO:teuthology.orchestra.run.smithi163.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 1.5 MB/s | 145 kB 00:00 2024-05-08T10:21:26.686 INFO:teuthology.orchestra.run.smithi163.stdout:(4/156): ceph-base-19.0.0-3538.gcd693b0b.el9.x8 3.2 MB/s | 5.4 MB 00:01 2024-05-08T10:21:27.165 INFO:teuthology.orchestra.run.smithi143.stdout:(10/156): ceph-radosgw-19.0.0-3538.gcd693b0b.el 6.9 MB/s | 11 MB 00:01 2024-05-08T10:21:27.169 INFO:teuthology.orchestra.run.smithi163.stdout:(5/156): ceph-mgr-19.0.0-3538.gcd693b0b.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-05-08T10:21:27.348 INFO:teuthology.orchestra.run.smithi143.stdout:(11/156): cephfs-mirror-19.0.0-3538.gcd693b0b.e 1.2 MB/s | 225 kB 00:00 2024-05-08T10:21:27.448 INFO:teuthology.orchestra.run.smithi143.stdout:(12/156): cephfs-shell-19.0.0-3538.gcd693b0b.el 270 kB/s | 27 kB 00:00 2024-05-08T10:21:27.653 INFO:teuthology.orchestra.run.smithi163.stdout:(6/156): ceph-mds-19.0.0-3538.gcd693b0b.el9.x86 2.1 MB/s | 2.4 MB 00:01 2024-05-08T10:21:28.032 INFO:teuthology.orchestra.run.smithi143.stdout:(13/156): libcephfs-devel-19.0.0-3538.gcd693b0b 54 kB/s | 32 kB 00:00 2024-05-08T10:21:28.332 INFO:teuthology.orchestra.run.smithi143.stdout:(14/156): libcephfs2-19.0.0-3538.gcd693b0b.el9. 2.4 MB/s | 746 kB 00:00 2024-05-08T10:21:28.361 INFO:teuthology.orchestra.run.smithi163.stdout:(7/156): ceph-mon-19.0.0-3538.gcd693b0b.el9.x86 3.9 MB/s | 4.7 MB 00:01 2024-05-08T10:21:28.466 INFO:teuthology.orchestra.run.smithi143.stdout:(15/156): libcephsqlite-19.0.0-3538.gcd693b0b.e 1.2 MB/s | 163 kB 00:00 2024-05-08T10:21:28.575 INFO:teuthology.orchestra.run.smithi143.stdout:(16/156): librados-devel-19.0.0-3538.gcd693b0b. 1.1 MB/s | 127 kB 00:00 2024-05-08T10:21:28.742 INFO:teuthology.orchestra.run.smithi143.stdout:(17/156): libradosstriper1-19.0.0-3538.gcd693b0 2.9 MB/s | 500 kB 00:00 2024-05-08T10:21:29.592 INFO:teuthology.orchestra.run.smithi143.stdout:(18/156): librgw2-19.0.0-3538.gcd693b0b.el9.x86 6.3 MB/s | 5.4 MB 00:00 2024-05-08T10:21:29.817 INFO:teuthology.orchestra.run.smithi143.stdout:(19/156): ceph-common-19.0.0-3538.gcd693b0b.el9 3.6 MB/s | 21 MB 00:05 2024-05-08T10:21:29.843 INFO:teuthology.orchestra.run.smithi143.stdout:(20/156): python3-ceph-argparse-19.0.0-3538.gcd 180 kB/s | 45 kB 00:00 2024-05-08T10:21:29.885 INFO:teuthology.orchestra.run.smithi143.stdout:(21/156): python3-ceph-common-19.0.0-3538.gcd69 2.0 MB/s | 135 kB 00:00 2024-05-08T10:21:29.960 INFO:teuthology.orchestra.run.smithi143.stdout:(22/156): python3-rados-19.0.0-3538.gcd693b0b.e 4.2 MB/s | 320 kB 00:00 2024-05-08T10:21:30.028 INFO:teuthology.orchestra.run.smithi143.stdout:(23/156): python3-rbd-19.0.0-3538.gcd693b0b.el9 4.4 MB/s | 301 kB 00:00 2024-05-08T10:21:30.077 INFO:teuthology.orchestra.run.smithi143.stdout:(24/156): python3-rgw-19.0.0-3538.gcd693b0b.el9 1.9 MB/s | 99 kB 00:00 2024-05-08T10:21:30.128 INFO:teuthology.orchestra.run.smithi143.stdout:(25/156): rbd-fuse-19.0.0-3538.gcd693b0b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-05-08T10:21:30.253 INFO:teuthology.orchestra.run.smithi163.stdout:(8/156): ceph-radosgw-19.0.0-3538.gcd693b0b.el9 5.6 MB/s | 11 MB 00:01 2024-05-08T10:21:30.361 INFO:teuthology.orchestra.run.smithi163.stdout:(9/156): ceph-selinux-19.0.0-3538.gcd693b0b.el9 233 kB/s | 25 kB 00:00 2024-05-08T10:21:30.394 INFO:teuthology.orchestra.run.smithi143.stdout:(26/156): python3-cephfs-19.0.0-3538.gcd693b0b. 293 kB/s | 161 kB 00:00 2024-05-08T10:21:30.495 INFO:teuthology.orchestra.run.smithi143.stdout:(27/156): rbd-nbd-19.0.0-3538.gcd693b0b.el9.x86 1.7 MB/s | 171 kB 00:00 2024-05-08T10:21:30.570 INFO:teuthology.orchestra.run.smithi143.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 457 kB/s | 34 kB 00:00 2024-05-08T10:21:30.662 INFO:teuthology.orchestra.run.smithi143.stdout:(29/156): rbd-mirror-19.0.0-3538.gcd693b0b.el9. 5.8 MB/s | 3.1 MB 00:00 2024-05-08T10:21:30.687 INFO:teuthology.orchestra.run.smithi143.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3538.gcd693b0 1.2 MB/s | 142 kB 00:00 2024-05-08T10:21:31.305 INFO:teuthology.orchestra.run.smithi143.stdout:(31/156): ceph-test-19.0.0-3538.gcd693b0b.el9.x 10 MB/s | 49 MB 00:04 2024-05-08T10:21:31.371 INFO:teuthology.orchestra.run.smithi143.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gcd 4.0 MB/s | 274 kB 00:00 2024-05-08T10:21:31.472 INFO:teuthology.orchestra.run.smithi143.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gcd693b0b.e 493 kB/s | 49 kB 00:00 2024-05-08T10:21:31.564 INFO:teuthology.orchestra.run.smithi143.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gc 180 kB/s | 16 kB 00:00 2024-05-08T10:21:31.622 INFO:teuthology.orchestra.run.smithi143.stdout:(35/156): ceph-mgr-dashboard-19.0.0-3538.gcd693 3.7 MB/s | 3.5 MB 00:00 2024-05-08T10:21:31.648 INFO:teuthology.orchestra.run.smithi143.stdout:(36/156): ceph-volume-19.0.0-3538.gcd693b0b.el9 3.2 MB/s | 273 kB 00:00 2024-05-08T10:21:31.723 INFO:teuthology.orchestra.run.smithi143.stdout:(37/156): cephfs-top-19.0.0-3538.gcd693b0b.el9. 243 kB/s | 18 kB 00:00 2024-05-08T10:21:31.824 INFO:teuthology.orchestra.run.smithi143.stdout:(38/156): cephadm-19.0.0-3538.gcd693b0b.el9.noa 3.7 MB/s | 764 kB 00:00 2024-05-08T10:21:32.000 INFO:teuthology.orchestra.run.smithi143.stdout:(39/156): ceph-mgr-diskprediction-local-19.0.0- 5.6 MB/s | 7.4 MB 00:01 2024-05-08T10:21:32.557 INFO:teuthology.orchestra.run.smithi143.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 96 kB/s | 80 kB 00:00 2024-05-08T10:21:32.824 INFO:teuthology.orchestra.run.smithi143.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 237 kB/s | 195 kB 00:00 2024-05-08T10:21:32.908 INFO:teuthology.orchestra.run.smithi143.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 740 kB/s | 803 kB 00:01 2024-05-08T10:21:32.995 INFO:teuthology.orchestra.run.smithi163.stdout:(10/156): ceph-common-19.0.0-3538.gcd693b0b.el9 2.7 MB/s | 21 MB 00:07 2024-05-08T10:21:33.062 INFO:teuthology.orchestra.run.smithi163.stdout:(11/156): cephfs-mirror-19.0.0-3538.gcd693b0b.e 3.3 MB/s | 225 kB 00:00 2024-05-08T10:21:33.104 INFO:teuthology.orchestra.run.smithi163.stdout:(12/156): cephfs-shell-19.0.0-3538.gcd693b0b.el 651 kB/s | 27 kB 00:00 2024-05-08T10:21:33.154 INFO:teuthology.orchestra.run.smithi163.stdout:(13/156): libcephfs-devel-19.0.0-3538.gcd693b0b 632 kB/s | 32 kB 00:00 2024-05-08T10:21:33.371 INFO:teuthology.orchestra.run.smithi163.stdout:(14/156): ceph-osd-19.0.0-3538.gcd693b0b.el9.x8 2.9 MB/s | 17 MB 00:05 2024-05-08T10:21:33.405 INFO:teuthology.orchestra.run.smithi163.stdout:(15/156): libcephfs2-19.0.0-3538.gcd693b0b.el9. 2.9 MB/s | 746 kB 00:00 2024-05-08T10:21:33.434 INFO:teuthology.orchestra.run.smithi143.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 289 kB/s | 253 kB 00:00 2024-05-08T10:21:33.438 INFO:teuthology.orchestra.run.smithi163.stdout:(16/156): libcephsqlite-19.0.0-3538.gcd693b0b.e 2.4 MB/s | 163 kB 00:00 2024-05-08T10:21:33.463 INFO:teuthology.orchestra.run.smithi163.stdout:(17/156): librados-devel-19.0.0-3538.gcd693b0b. 2.1 MB/s | 127 kB 00:00 2024-05-08T10:21:33.581 INFO:teuthology.orchestra.run.smithi163.stdout:(18/156): libradosstriper1-19.0.0-3538.gcd693b0 3.4 MB/s | 500 kB 00:00 2024-05-08T10:21:33.656 INFO:teuthology.orchestra.run.smithi163.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gcd 604 kB/s | 45 kB 00:00 2024-05-08T10:21:33.659 INFO:teuthology.orchestra.run.smithi143.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 142 kB/s | 106 kB 00:00 2024-05-08T10:21:33.731 INFO:teuthology.orchestra.run.smithi163.stdout:(20/156): python3-ceph-common-19.0.0-3538.gcd69 1.8 MB/s | 135 kB 00:00 2024-05-08T10:21:33.806 INFO:teuthology.orchestra.run.smithi163.stdout:(21/156): python3-cephfs-19.0.0-3538.gcd693b0b. 2.1 MB/s | 161 kB 00:00 2024-05-08T10:21:33.884 INFO:teuthology.orchestra.run.smithi143.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-05-08T10:21:33.915 INFO:teuthology.orchestra.run.smithi163.stdout:(22/156): python3-rados-19.0.0-3538.gcd693b0b.e 2.9 MB/s | 320 kB 00:00 2024-05-08T10:21:34.015 INFO:teuthology.orchestra.run.smithi163.stdout:(23/156): python3-rbd-19.0.0-3538.gcd693b0b.el9 2.9 MB/s | 301 kB 00:00 2024-05-08T10:21:34.082 INFO:teuthology.orchestra.run.smithi163.stdout:(24/156): python3-rgw-19.0.0-3538.gcd693b0b.el9 1.5 MB/s | 99 kB 00:00 2024-05-08T10:21:34.149 INFO:teuthology.orchestra.run.smithi163.stdout:(25/156): rbd-fuse-19.0.0-3538.gcd693b0b.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-08T10:21:34.193 INFO:teuthology.orchestra.run.smithi143.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 178 kB/s | 135 kB 00:00 2024-05-08T10:21:34.391 INFO:teuthology.orchestra.run.smithi163.stdout:(26/156): librgw2-19.0.0-3538.gcd693b0b.el9.x86 5.8 MB/s | 5.4 MB 00:00 2024-05-08T10:21:34.410 INFO:teuthology.orchestra.run.smithi143.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 173 kB/s | 125 kB 00:00 2024-05-08T10:21:34.441 INFO:teuthology.orchestra.run.smithi163.stdout:(27/156): rbd-nbd-19.0.0-3538.gcd693b0b.el9.x86 3.4 MB/s | 171 kB 00:00 2024-05-08T10:21:34.500 INFO:teuthology.orchestra.run.smithi163.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 589 kB/s | 34 kB 00:00 2024-05-08T10:21:34.559 INFO:teuthology.orchestra.run.smithi163.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3538.gcd693b0 2.4 MB/s | 142 kB 00:00 2024-05-08T10:21:34.702 INFO:teuthology.orchestra.run.smithi143.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 263 kB/s | 215 kB 00:00 2024-05-08T10:21:34.917 INFO:teuthology.orchestra.run.smithi163.stdout:(30/156): rbd-mirror-19.0.0-3538.gcd693b0b.el9. 4.0 MB/s | 3.1 MB 00:00 2024-05-08T10:21:35.059 INFO:teuthology.orchestra.run.smithi163.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3538.gcd693 7.1 MB/s | 3.5 MB 00:00 2024-05-08T10:21:35.126 INFO:teuthology.orchestra.run.smithi163.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gcd 4.0 MB/s | 274 kB 00:00 2024-05-08T10:21:35.160 INFO:teuthology.orchestra.run.smithi143.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 713 kB/s | 689 kB 00:00 2024-05-08T10:21:35.177 INFO:teuthology.orchestra.run.smithi163.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gcd693b0b.e 987 kB/s | 49 kB 00:00 2024-05-08T10:21:35.235 INFO:teuthology.orchestra.run.smithi163.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gc 283 kB/s | 16 kB 00:00 2024-05-08T10:21:35.319 INFO:teuthology.orchestra.run.smithi163.stdout:(35/156): ceph-volume-19.0.0-3538.gcd693b0b.el9 3.2 MB/s | 273 kB 00:00 2024-05-08T10:21:35.444 INFO:teuthology.orchestra.run.smithi143.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 144 kB/s | 107 kB 00:00 2024-05-08T10:21:35.461 INFO:teuthology.orchestra.run.smithi163.stdout:(36/156): cephadm-19.0.0-3538.gcd693b0b.el9.noa 5.3 MB/s | 764 kB 00:00 2024-05-08T10:21:35.477 INFO:teuthology.orchestra.run.smithi143.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 884 kB/s | 943 kB 00:01 2024-05-08T10:21:35.511 INFO:teuthology.orchestra.run.smithi163.stdout:(37/156): cephfs-top-19.0.0-3538.gcd693b0b.el9. 366 kB/s | 18 kB 00:00 2024-05-08T10:21:35.661 INFO:teuthology.orchestra.run.smithi163.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 536 kB/s | 80 kB 00:00 2024-05-08T10:21:35.753 INFO:teuthology.orchestra.run.smithi143.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 36 kB/s | 21 kB 00:00 2024-05-08T10:21:36.086 INFO:teuthology.orchestra.run.smithi143.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-05-08T10:21:36.145 INFO:teuthology.orchestra.run.smithi163.stdout:(39/156): ceph-test-19.0.0-3538.gcd693b0b.el9.x 8.5 MB/s | 49 MB 00:05 2024-05-08T10:21:36.212 INFO:teuthology.orchestra.run.smithi163.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2024-05-08T10:21:36.262 INFO:teuthology.orchestra.run.smithi163.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-05-08T10:21:36.287 INFO:teuthology.orchestra.run.smithi143.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 372 kB/s | 313 kB 00:00 2024-05-08T10:21:36.288 INFO:teuthology.orchestra.run.smithi163.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-05-08T10:21:36.438 INFO:teuthology.orchestra.run.smithi163.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 710 kB/s | 106 kB 00:00 2024-05-08T10:21:36.471 INFO:teuthology.orchestra.run.smithi163.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-05-08T10:21:36.497 INFO:teuthology.orchestra.run.smithi163.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-08T10:21:36.522 INFO:teuthology.orchestra.run.smithi163.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-05-08T10:21:36.581 INFO:teuthology.orchestra.run.smithi163.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-08T10:21:36.603 INFO:teuthology.orchestra.run.smithi143.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-05-08T10:21:36.706 INFO:teuthology.orchestra.run.smithi163.stdout:(48/156): ceph-mgr-diskprediction-local-19.0.0- 4.1 MB/s | 7.4 MB 00:01 2024-05-08T10:21:36.787 INFO:teuthology.orchestra.run.smithi143.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-05-08T10:21:36.871 INFO:teuthology.orchestra.run.smithi143.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-05-08T10:21:37.123 INFO:teuthology.orchestra.run.smithi163.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 257 kB/s | 107 kB 00:00 2024-05-08T10:21:37.223 INFO:teuthology.orchestra.run.smithi163.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 214 kB/s | 21 kB 00:00 2024-05-08T10:21:37.290 INFO:teuthology.orchestra.run.smithi163.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 897 kB/s | 689 kB 00:00 2024-05-08T10:21:37.390 INFO:teuthology.orchestra.run.smithi163.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-05-08T10:21:37.421 INFO:teuthology.orchestra.run.smithi143.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 196 kB/s | 160 kB 00:00 2024-05-08T10:21:37.447 INFO:teuthology.orchestra.run.smithi143.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 69 kB/s | 45 kB 00:00 2024-05-08T10:21:37.507 INFO:teuthology.orchestra.run.smithi163.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-05-08T10:21:37.541 INFO:teuthology.orchestra.run.smithi163.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 982 kB/s | 943 kB 00:00 2024-05-08T10:21:37.600 INFO:teuthology.orchestra.run.smithi163.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-05-08T10:21:37.633 INFO:teuthology.orchestra.run.smithi163.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-05-08T10:21:37.709 INFO:teuthology.orchestra.run.smithi163.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-08T10:21:37.742 INFO:teuthology.orchestra.run.smithi163.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-05-08T10:21:37.822 INFO:teuthology.orchestra.run.smithi143.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 716 kB/s | 662 kB 00:00 2024-05-08T10:21:37.868 INFO:teuthology.orchestra.run.smithi163.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.3 MB/s | 3.0 MB 00:00 2024-05-08T10:21:37.976 INFO:teuthology.orchestra.run.smithi163.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 2.4 MB/s | 582 kB 00:00 2024-05-08T10:21:38.001 INFO:teuthology.orchestra.run.smithi163.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 190 kB/s | 25 kB 00:00 2024-05-08T10:21:38.022 INFO:teuthology.orchestra.run.smithi143.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 44 kB/s | 25 kB 00:00 2024-05-08T10:21:38.027 INFO:teuthology.orchestra.run.smithi163.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-05-08T10:21:38.077 INFO:teuthology.orchestra.run.smithi163.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-05-08T10:21:38.111 INFO:teuthology.orchestra.run.smithi163.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-08T10:21:38.136 INFO:teuthology.orchestra.run.smithi163.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-08T10:21:38.178 INFO:teuthology.orchestra.run.smithi163.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 350 kB/s | 35 kB 00:00 2024-05-08T10:21:38.339 INFO:teuthology.orchestra.run.smithi143.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 635 kB/s | 582 kB 00:00 2024-05-08T10:21:38.461 INFO:teuthology.orchestra.run.smithi163.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-05-08T10:21:38.464 INFO:teuthology.orchestra.run.smithi143.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-05-08T10:21:38.537 INFO:teuthology.orchestra.run.smithi163.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2024-05-08T10:21:38.596 INFO:teuthology.orchestra.run.smithi163.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 6.7 MB/s | 911 kB 00:00 2024-05-08T10:21:38.645 INFO:teuthology.orchestra.run.smithi163.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-05-08T10:21:38.721 INFO:teuthology.orchestra.run.smithi163.stdout:(71/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-05-08T10:21:38.821 INFO:teuthology.orchestra.run.smithi163.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 874 kB/s | 87 kB 00:00 2024-05-08T10:21:38.857 INFO:teuthology.orchestra.run.smithi143.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 351 kB/s | 292 kB 00:00 2024-05-08T10:21:39.099 INFO:teuthology.orchestra.run.smithi143.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 56 kB/s | 35 kB 00:00 2024-05-08T10:21:39.149 INFO:teuthology.orchestra.run.smithi143.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 233 kB/s | 188 kB 00:00 2024-05-08T10:21:39.422 INFO:teuthology.orchestra.run.smithi163.stdout:(73/156): python3-babel-2.9.1-2.el9.noarch.rpm 9.9 MB/s | 6.0 MB 00:00 2024-05-08T10:21:39.538 INFO:teuthology.orchestra.run.smithi163.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-05-08T10:21:39.655 INFO:teuthology.orchestra.run.smithi163.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-05-08T10:21:39.765 INFO:teuthology.orchestra.run.smithi163.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-05-08T10:21:39.864 INFO:teuthology.orchestra.run.smithi163.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 192 kB/s | 19 kB 00:00 2024-05-08T10:21:39.973 INFO:teuthology.orchestra.run.smithi163.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-05-08T10:21:40.023 INFO:teuthology.orchestra.run.smithi163.stdout:(79/156): protobuf-3.14.0-13.el9.x86_64.rpm 750 kB/s | 1.0 MB 00:01 2024-05-08T10:21:40.073 INFO:teuthology.orchestra.run.smithi163.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-05-08T10:21:40.099 INFO:teuthology.orchestra.run.smithi143.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.8 MB/s | 4.7 MB 00:01 2024-05-08T10:21:40.182 INFO:teuthology.orchestra.run.smithi163.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-05-08T10:21:40.241 INFO:teuthology.orchestra.run.smithi143.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-05-08T10:21:40.290 INFO:teuthology.orchestra.run.smithi163.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-05-08T10:21:40.317 INFO:teuthology.orchestra.run.smithi143.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-05-08T10:21:40.391 INFO:teuthology.orchestra.run.smithi163.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 772 kB/s | 77 kB 00:00 2024-05-08T10:21:40.491 INFO:teuthology.orchestra.run.smithi163.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 423 kB/s | 42 kB 00:00 2024-05-08T10:21:40.600 INFO:teuthology.orchestra.run.smithi163.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-05-08T10:21:40.700 INFO:teuthology.orchestra.run.smithi163.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-05-08T10:21:40.808 INFO:teuthology.orchestra.run.smithi163.stdout:(87/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-05-08T10:21:40.909 INFO:teuthology.orchestra.run.smithi163.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2024-05-08T10:21:41.001 INFO:teuthology.orchestra.run.smithi163.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 585 kB/s | 54 kB 00:00 2024-05-08T10:21:41.008 INFO:teuthology.orchestra.run.smithi143.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 174 kB/s | 133 kB 00:00 2024-05-08T10:21:41.075 INFO:teuthology.orchestra.run.smithi143.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 934 kB/s | 911 kB 00:00 2024-05-08T10:21:41.567 INFO:teuthology.orchestra.run.smithi143.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-05-08T10:21:41.776 INFO:teuthology.orchestra.run.smithi143.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 125 kB/s | 87 kB 00:00 2024-05-08T10:21:42.060 INFO:teuthology.orchestra.run.smithi143.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 983 kB/s | 1.0 MB 00:01 2024-05-08T10:21:42.627 INFO:teuthology.orchestra.run.smithi143.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 287 kB/s | 244 kB 00:00 2024-05-08T10:21:42.877 INFO:teuthology.orchestra.run.smithi143.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-05-08T10:21:43.019 INFO:teuthology.orchestra.run.smithi143.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 258 kB/s | 248 kB 00:00 2024-05-08T10:21:43.361 INFO:teuthology.orchestra.run.smithi143.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 35 kB/s | 26 kB 00:00 2024-05-08T10:21:43.461 INFO:teuthology.orchestra.run.smithi143.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 33 kB/s | 19 kB 00:00 2024-05-08T10:21:43.861 INFO:teuthology.orchestra.run.smithi143.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 204 kB/s | 172 kB 00:00 2024-05-08T10:21:44.020 INFO:teuthology.orchestra.run.smithi143.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 53 kB/s | 35 kB 00:00 2024-05-08T10:21:44.704 INFO:teuthology.orchestra.run.smithi143.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-05-08T10:21:44.729 INFO:teuthology.orchestra.run.smithi143.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 289 kB/s | 250 kB 00:00 2024-05-08T10:21:44.837 INFO:teuthology.orchestra.run.smithi143.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 272 kB/s | 222 kB 00:00 2024-05-08T10:21:44.934 INFO:teuthology.orchestra.run.smithi163.stdout:(90/156): postgresql-server-13.14-1.el9.x86_64. 934 kB/s | 5.8 MB 00:06 2024-05-08T10:21:45.042 INFO:teuthology.orchestra.run.smithi163.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-05-08T10:21:45.143 INFO:teuthology.orchestra.run.smithi163.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-05-08T10:21:45.338 INFO:teuthology.orchestra.run.smithi143.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 69 kB/s | 42 kB 00:00 2024-05-08T10:21:45.372 INFO:teuthology.orchestra.run.smithi143.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 116 kB/s | 77 kB 00:00 2024-05-08T10:21:45.485 INFO:teuthology.orchestra.run.smithi163.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 646 kB/s | 221 kB 00:00 2024-05-08T10:21:45.635 INFO:teuthology.orchestra.run.smithi163.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 239 kB/s | 36 kB 00:00 2024-05-08T10:21:45.646 INFO:teuthology.orchestra.run.smithi143.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 333 kB/s | 269 kB 00:00 2024-05-08T10:21:45.744 INFO:teuthology.orchestra.run.smithi163.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-05-08T10:21:46.130 INFO:teuthology.orchestra.run.smithi143.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 200 kB/s | 159 kB 00:00 2024-05-08T10:21:46.169 INFO:teuthology.orchestra.run.smithi163.stdout:(96/156): socat-1.7.4.1-5.el9.x86_64.rpm 717 kB/s | 305 kB 00:00 2024-05-08T10:21:46.222 INFO:teuthology.orchestra.run.smithi143.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 328 kB/s | 279 kB 00:00 2024-05-08T10:21:46.278 INFO:teuthology.orchestra.run.smithi163.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-05-08T10:21:46.297 INFO:teuthology.orchestra.run.smithi143.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 78 kB/s | 51 kB 00:00 2024-05-08T10:21:46.478 INFO:teuthology.orchestra.run.smithi163.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 468 kB/s | 94 kB 00:00 2024-05-08T10:21:46.695 INFO:teuthology.orchestra.run.smithi163.stdout:(99/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 294 kB/s | 64 kB 00:00 2024-05-08T10:21:46.804 INFO:teuthology.orchestra.run.smithi163.stdout:(100/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-05-08T10:21:46.848 INFO:teuthology.orchestra.run.smithi143.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 75 kB/s | 54 kB 00:00 2024-05-08T10:21:46.915 INFO:teuthology.orchestra.run.smithi143.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-05-08T10:21:46.937 INFO:teuthology.orchestra.run.smithi163.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-05-08T10:21:47.212 INFO:teuthology.orchestra.run.smithi163.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-05-08T10:21:47.454 INFO:teuthology.orchestra.run.smithi163.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.2 MB/s | 548 kB 00:00 2024-05-08T10:21:47.546 INFO:teuthology.orchestra.run.smithi163.stdout:(104/156): python3-numpy-1.20.1-5.el9.x86_64.rp 694 kB/s | 5.1 MB 00:07 2024-05-08T10:21:47.572 INFO:teuthology.orchestra.run.smithi163.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-05-08T10:21:47.574 INFO:teuthology.orchestra.run.smithi143.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 61 kB/s | 44 kB 00:00 2024-05-08T10:21:47.613 INFO:teuthology.orchestra.run.smithi163.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 294 kB/s | 19 kB 00:00 2024-05-08T10:21:47.891 INFO:teuthology.orchestra.run.smithi143.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 226 kB/s | 221 kB 00:00 2024-05-08T10:21:48.014 INFO:teuthology.orchestra.run.smithi163.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 65 kB/s | 26 kB 00:00 2024-05-08T10:21:48.066 INFO:teuthology.orchestra.run.smithi143.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.8 MB/s | 16 MB 00:01 2024-05-08T10:21:48.098 INFO:teuthology.orchestra.run.smithi163.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-05-08T10:21:48.123 INFO:teuthology.orchestra.run.smithi163.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 457 kB/s | 49 kB 00:00 2024-05-08T10:21:48.223 INFO:teuthology.orchestra.run.smithi163.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 539 kB/s | 67 kB 00:00 2024-05-08T10:21:48.290 INFO:teuthology.orchestra.run.smithi163.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 906 kB/s | 151 kB 00:00 2024-05-08T10:21:48.391 INFO:teuthology.orchestra.run.smithi143.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 44 kB/s | 36 kB 00:00 2024-05-08T10:21:48.432 INFO:teuthology.orchestra.run.smithi163.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-05-08T10:21:48.457 INFO:teuthology.orchestra.run.smithi163.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-05-08T10:21:48.491 INFO:teuthology.orchestra.run.smithi163.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 758 kB/s | 43 kB 00:00 2024-05-08T10:21:48.516 INFO:teuthology.orchestra.run.smithi163.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-05-08T10:21:48.683 INFO:teuthology.orchestra.run.smithi163.stdout:(116/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-05-08T10:21:48.700 INFO:teuthology.orchestra.run.smithi143.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 59 kB/s | 47 kB 00:00 2024-05-08T10:21:48.708 INFO:teuthology.orchestra.run.smithi163.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 69 kB/s | 15 kB 00:00 2024-05-08T10:21:48.734 INFO:teuthology.orchestra.run.smithi163.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 791 kB/s | 172 kB 00:00 2024-05-08T10:21:48.759 INFO:teuthology.orchestra.run.smithi163.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-05-08T10:21:48.859 INFO:teuthology.orchestra.run.smithi163.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-05-08T10:21:48.884 INFO:teuthology.orchestra.run.smithi163.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 236 kB/s | 35 kB 00:00 2024-05-08T10:21:48.926 INFO:teuthology.orchestra.run.smithi163.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.2 MB/s | 206 kB 00:00 2024-05-08T10:21:49.008 INFO:teuthology.orchestra.run.smithi143.stdout:(98/156): socat-1.7.4.1-5.el9.x86_64.rpm 324 kB/s | 305 kB 00:00 2024-05-08T10:21:49.125 INFO:teuthology.orchestra.run.smithi143.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 79 kB/s | 58 kB 00:00 2024-05-08T10:21:49.268 INFO:teuthology.orchestra.run.smithi163.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.0 MB/s | 2.0 MB 00:00 2024-05-08T10:21:49.285 INFO:teuthology.orchestra.run.smithi163.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 361 kB/s | 144 kB 00:00 2024-05-08T10:21:49.344 INFO:teuthology.orchestra.run.smithi163.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 26 kB/s | 11 kB 00:00 2024-05-08T10:21:49.419 INFO:teuthology.orchestra.run.smithi163.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 117 kB/s | 18 kB 00:00 2024-05-08T10:21:49.442 INFO:teuthology.orchestra.run.smithi143.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 126 kB/s | 94 kB 00:00 2024-05-08T10:21:49.445 INFO:teuthology.orchestra.run.smithi163.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 146 kB/s | 23 kB 00:00 2024-05-08T10:21:49.470 INFO:teuthology.orchestra.run.smithi163.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 155 kB/s | 19 kB 00:00 2024-05-08T10:21:49.495 INFO:teuthology.orchestra.run.smithi163.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-05-08T10:21:49.526 INFO:teuthology.orchestra.run.smithi143.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-05-08T10:21:49.570 INFO:teuthology.orchestra.run.smithi163.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-05-08T10:21:49.604 INFO:teuthology.orchestra.run.smithi163.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 347 kB/s | 46 kB 00:00 2024-05-08T10:21:49.629 INFO:teuthology.orchestra.run.smithi163.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 589 kB/s | 79 kB 00:00 2024-05-08T10:21:49.654 INFO:teuthology.orchestra.run.smithi163.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-05-08T10:21:49.668 INFO:teuthology.orchestra.run.smithi143.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 97 kB/s | 64 kB 00:00 2024-05-08T10:21:49.688 INFO:teuthology.orchestra.run.smithi163.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-05-08T10:21:49.713 INFO:teuthology.orchestra.run.smithi163.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 283 kB/s | 16 kB 00:00 2024-05-08T10:21:49.738 INFO:teuthology.orchestra.run.smithi163.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-05-08T10:21:49.743 INFO:teuthology.orchestra.run.smithi143.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-05-08T10:21:49.789 INFO:teuthology.orchestra.run.smithi163.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-05-08T10:21:49.810 INFO:teuthology.orchestra.run.smithi143.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-05-08T10:21:49.814 INFO:teuthology.orchestra.run.smithi163.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-05-08T10:21:49.839 INFO:teuthology.orchestra.run.smithi163.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-08T10:21:49.864 INFO:teuthology.orchestra.run.smithi163.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 790 kB/s | 59 kB 00:00 2024-05-08T10:21:49.914 INFO:teuthology.orchestra.run.smithi163.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 478 kB/s | 36 kB 00:00 2024-05-08T10:21:49.940 INFO:teuthology.orchestra.run.smithi163.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 510 kB/s | 51 kB 00:00 2024-05-08T10:21:50.007 INFO:teuthology.orchestra.run.smithi163.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-05-08T10:21:50.032 INFO:teuthology.orchestra.run.smithi163.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 771 kB/s | 90 kB 00:00 2024-05-08T10:21:50.057 INFO:teuthology.orchestra.run.smithi163.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 8.4 MB/s | 427 kB 00:00 2024-05-08T10:21:50.074 INFO:teuthology.orchestra.run.smithi163.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-05-08T10:21:50.133 INFO:teuthology.orchestra.run.smithi163.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-05-08T10:21:50.185 INFO:teuthology.orchestra.run.smithi143.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 52 kB/s | 19 kB 00:00 2024-05-08T10:21:50.191 INFO:teuthology.orchestra.run.smithi163.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-08T10:21:50.408 INFO:teuthology.orchestra.run.smithi163.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-05-08T10:21:50.411 INFO:teuthology.orchestra.run.smithi143.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 463 kB/s | 309 kB 00:00 2024-05-08T10:21:50.436 INFO:teuthology.orchestra.run.smithi143.stdout:(107/156): abseil-cpp-20211102.0-3.el9.x86_64.r 714 kB/s | 548 kB 00:00 2024-05-08T10:21:50.520 INFO:teuthology.orchestra.run.smithi143.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-05-08T10:21:50.525 INFO:teuthology.orchestra.run.smithi163.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 16 MB/s | 1.8 MB 00:00 2024-05-08T10:21:50.553 INFO:teuthology.orchestra.run.smithi143.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-05-08T10:21:50.576 INFO:teuthology.orchestra.run.smithi163.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 836 kB/s | 42 kB 00:00 2024-05-08T10:21:50.626 INFO:teuthology.orchestra.run.smithi163.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.9 MB/s | 248 kB 00:00 2024-05-08T10:21:50.645 INFO:teuthology.orchestra.run.smithi143.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 538 kB/s | 67 kB 00:00 2024-05-08T10:21:50.687 INFO:teuthology.orchestra.run.smithi143.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-05-08T10:21:50.726 INFO:teuthology.orchestra.run.smithi163.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 14 MB/s | 1.3 MB 00:00 2024-05-08T10:21:50.777 INFO:teuthology.orchestra.run.smithi163.stdout:(154/156): librbd1-19.0.0-3538.gcd693b0b.el9.x8 4.9 MB/s | 3.1 MB 00:00 2024-05-08T10:21:50.860 INFO:teuthology.orchestra.run.smithi163.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-05-08T10:21:50.879 INFO:teuthology.orchestra.run.smithi143.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-05-08T10:21:50.946 INFO:teuthology.orchestra.run.smithi143.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.7 MB/s | 839 kB 00:00 2024-05-08T10:21:51.027 INFO:teuthology.orchestra.run.smithi163.stdout:(156/156): librados2-19.0.0-3538.gcd693b0b.el9. 3.6 MB/s | 3.4 MB 00:00 2024-05-08T10:21:51.030 INFO:teuthology.orchestra.run.smithi143.stdout:(114/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2024-05-08T10:21:51.031 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-05-08T10:21:51.031 INFO:teuthology.orchestra.run.smithi163.stdout:Total 8.5 MB/s | 226 MB 00:26 2024-05-08T10:21:51.055 INFO:teuthology.orchestra.run.smithi143.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 247 kB/s | 43 kB 00:00 2024-05-08T10:21:51.080 INFO:teuthology.orchestra.run.smithi143.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 240 kB/s | 32 kB 00:00 2024-05-08T10:21:51.148 INFO:teuthology.orchestra.run.smithi143.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 127 kB/s | 15 kB 00:00 2024-05-08T10:21:51.181 INFO:teuthology.orchestra.run.smithi143.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-05-08T10:21:51.215 INFO:teuthology.orchestra.run.smithi143.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-05-08T10:21:51.274 INFO:teuthology.orchestra.run.smithi143.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-05-08T10:21:51.299 INFO:teuthology.orchestra.run.smithi143.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 300 kB/s | 35 kB 00:00 2024-05-08T10:21:51.341 INFO:teuthology.orchestra.run.smithi143.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-05-08T10:21:51.458 INFO:teuthology.orchestra.run.smithi143.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-05-08T10:21:51.475 INFO:teuthology.orchestra.run.smithi143.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2024-05-08T10:21:51.500 INFO:teuthology.orchestra.run.smithi143.stdout:(125/156): python3-grpcio-tools-1.46.7-10.el9.x 719 kB/s | 144 kB 00:00 2024-05-08T10:21:51.559 INFO:teuthology.orchestra.run.smithi143.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 175 kB/s | 18 kB 00:00 2024-05-08T10:21:51.576 INFO:teuthology.orchestra.run.smithi143.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-05-08T10:21:51.601 INFO:teuthology.orchestra.run.smithi143.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-05-08T10:21:51.660 INFO:teuthology.orchestra.run.smithi143.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2024-05-08T10:21:51.718 INFO:teuthology.orchestra.run.smithi143.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-05-08T10:21:51.735 INFO:teuthology.orchestra.run.smithi143.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 345 kB/s | 46 kB 00:00 2024-05-08T10:21:51.786 INFO:teuthology.orchestra.run.smithi143.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 627 kB/s | 79 kB 00:00 2024-05-08T10:21:51.819 INFO:teuthology.orchestra.run.smithi143.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 573 kB/s | 58 kB 00:00 2024-05-08T10:21:51.870 INFO:teuthology.orchestra.run.smithi143.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-05-08T10:21:51.886 INFO:teuthology.orchestra.run.smithi143.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-05-08T10:21:51.929 INFO:teuthology.orchestra.run.smithi143.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 824 kB/s | 90 kB 00:00 2024-05-08T10:21:51.979 INFO:teuthology.orchestra.run.smithi143.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 259 kB/s | 28 kB 00:00 2024-05-08T10:21:51.996 INFO:teuthology.orchestra.run.smithi143.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-05-08T10:21:52.038 INFO:teuthology.orchestra.run.smithi143.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-05-08T10:21:52.088 INFO:teuthology.orchestra.run.smithi143.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 542 kB/s | 59 kB 00:00 2024-05-08T10:21:52.105 INFO:teuthology.orchestra.run.smithi143.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-05-08T10:21:52.139 INFO:teuthology.orchestra.run.smithi143.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-05-08T10:21:52.214 INFO:teuthology.orchestra.run.smithi143.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-05-08T10:21:52.241 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-05-08T10:21:52.248 INFO:teuthology.orchestra.run.smithi143.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 630 kB/s | 90 kB 00:00 2024-05-08T10:21:52.273 INFO:teuthology.orchestra.run.smithi143.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-05-08T10:21:52.365 INFO:teuthology.orchestra.run.smithi143.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-05-08T10:21:52.390 INFO:teuthology.orchestra.run.smithi143.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-05-08T10:21:52.395 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-05-08T10:21:52.395 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-05-08T10:21:52.516 INFO:teuthology.orchestra.run.smithi143.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-05-08T10:21:52.883 INFO:teuthology.orchestra.run.smithi143.stdout:(149/156): librbd1-19.0.0-3538.gcd693b0b.el9.x8 6.4 MB/s | 3.1 MB 00:00 2024-05-08T10:21:52.950 INFO:teuthology.orchestra.run.smithi143.stdout:(150/156): librados2-19.0.0-3538.gcd693b0b.el9. 5.8 MB/s | 3.4 MB 00:00 2024-05-08T10:21:53.567 INFO:teuthology.orchestra.run.smithi143.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 68 kB/s | 42 kB 00:00 2024-05-08T10:21:53.617 INFO:teuthology.orchestra.run.smithi143.stdout:(152/156): NetworkManager-1.47.5-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2024-05-08T10:21:53.951 INFO:teuthology.orchestra.run.smithi143.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-05-08T10:21:54.376 INFO:teuthology.orchestra.run.smithi143.stdout:(154/156): NetworkManager-tui-1.47.5-1.el9.x86_ 307 kB/s | 248 kB 00:00 2024-05-08T10:21:54.597 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-05-08T10:21:54.598 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-05-08T10:21:54.668 INFO:teuthology.orchestra.run.smithi143.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:01 2024-05-08T10:21:55.094 INFO:teuthology.orchestra.run.smithi143.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-05-08T10:21:55.101 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-05-08T10:21:55.101 INFO:teuthology.orchestra.run.smithi143.stdout:Total 7.2 MB/s | 226 MB 00:31 2024-05-08T10:21:56.318 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-05-08T10:21:56.470 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-05-08T10:21:56.470 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-05-08T10:21:58.634 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-05-08T10:21:58.634 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-05-08T10:22:00.799 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-05-08T10:22:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T10:22:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T10:22:00.967 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T10:22:01.007 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T10:22:01.033 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T10:22:01.092 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T10:22:01.425 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T10:22:01.533 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-08T10:22:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-08T10:22:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-08T10:22:01.768 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-08T10:22:01.798 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 10/164 2024-05-08T10:22:01.978 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T10:22:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T10:22:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-08T10:22:02.167 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-08T10:22:02.190 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 14/164 2024-05-08T10:22:02.255 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 14/164 2024-05-08T10:22:02.274 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T10:22:02.301 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T10:22:02.501 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T10:22:02.675 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T10:22:02.813 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T10:22:02.873 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T10:22:02.997 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:22:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:22:03.264 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:22:03.372 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T10:22:03.404 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T10:22:03.447 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T10:22:03.521 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T10:22:03.563 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T10:22:03.606 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T10:22:03.640 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T10:22:03.667 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T10:22:03.736 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T10:22:03.789 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T10:22:03.828 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T10:22:03.871 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T10:22:03.946 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T10:22:03.982 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9. 32/164 2024-05-08T10:22:04.026 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el 33/164 2024-05-08T10:22:04.063 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_6 34/164 2024-05-08T10:22:04.132 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T10:22:04.178 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T10:22:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T10:22:04.382 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T10:22:04.438 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T10:22:04.693 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-05-08T10:22:04.848 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T10:22:04.895 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T10:22:04.953 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T10:22:04.954 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T10:22:04.990 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T10:22:05.016 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T10:22:05.049 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T10:22:05.071 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T10:22:05.079 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T10:22:05.122 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T10:22:05.161 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_6 44/164 2024-05-08T10:22:05.203 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T10:22:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T10:22:05.405 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T10:22:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T10:22:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T10:22:05.508 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-08T10:22:05.569 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T10:22:05.612 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-08T10:22:05.641 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T10:22:05.643 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-08T10:22:05.673 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T10:22:05.710 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T10:22:05.721 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-08T10:22:05.756 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 10/164 2024-05-08T10:22:05.757 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T10:22:05.793 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T10:22:05.836 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T10:22:05.877 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T10:22:05.927 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T10:22:05.986 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T10:22:06.012 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T10:22:06.014 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-08T10:22:06.058 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T10:22:06.097 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T10:22:06.118 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-08T10:22:06.138 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T10:22:06.140 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 14/164 2024-05-08T10:22:06.203 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 14/164 2024-05-08T10:22:06.225 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T10:22:06.233 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T10:22:06.250 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T10:22:06.263 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T10:22:06.315 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T10:22:06.354 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T10:22:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T10:22:06.436 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T10:22:06.478 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T10:22:06.603 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T10:22:06.605 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T10:22:06.636 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T10:22:06.664 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T10:22:06.698 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T10:22:06.737 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T10:22:06.756 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T10:22:06.770 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T10:22:06.799 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T10:22:06.816 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T10:22:06.833 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T10:22:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T10:22:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T10:22:06.928 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:22:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T10:22:07.001 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:22:07.029 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T10:22:07.074 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T10:22:07.112 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T10:22:07.159 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T10:22:07.216 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:22:07.257 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T10:22:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T10:22:07.326 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T10:22:07.356 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T10:22:07.399 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T10:22:07.472 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T10:22:07.506 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T10:22:07.550 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T10:22:07.586 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T10:22:07.611 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T10:22:07.679 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T10:22:07.733 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T10:22:07.763 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T10:22:07.827 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T10:22:07.900 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T10:22:07.943 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9. 32/164 2024-05-08T10:22:07.986 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el 33/164 2024-05-08T10:22:08.015 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_6 34/164 2024-05-08T10:22:08.020 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T10:22:08.069 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T10:22:08.085 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T10:22:08.103 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T10:22:08.129 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T10:22:08.201 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T10:22:08.204 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T10:22:08.252 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T10:22:08.338 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T10:22:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T10:22:08.391 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T10:22:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T10:22:08.575 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T10:22:08.602 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T10:22:08.682 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T10:22:08.929 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T10:22:09.020 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T10:22:09.049 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T10:22:09.083 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T10:22:09.122 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_6 44/164 2024-05-08T10:22:09.164 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T10:22:09.319 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T10:22:09.334 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T10:22:09.366 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T10:22:09.450 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T10:22:09.458 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T10:22:09.531 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T10:22:09.604 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T10:22:09.635 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T10:22:09.671 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T10:22:09.718 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T10:22:09.754 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T10:22:09.797 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T10:22:09.840 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T10:22:09.976 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T10:22:10.029 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T10:22:10.059 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T10:22:10.100 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T10:22:10.195 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T10:22:10.226 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T10:22:10.267 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T10:22:10.308 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T10:22:10.333 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T10:22:10.433 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T10:22:10.560 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T10:22:10.591 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T10:22:10.619 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T10:22:10.653 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T10:22:10.692 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T10:22:10.724 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T10:22:10.727 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T10:22:10.754 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T10:22:10.789 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T10:22:10.823 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T10:22:10.830 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T10:22:10.850 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T10:22:10.872 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T10:22:10.884 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T10:22:10.906 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T10:22:10.994 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T10:22:11.037 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T10:22:11.068 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T10:22:11.115 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T10:22:11.208 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T10:22:11.213 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T10:22:11.247 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 101/164 2024-05-08T10:22:11.270 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T10:22:11.338 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 101/164 2024-05-08T10:22:11.368 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 102/164 2024-05-08T10:22:11.405 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T10:22:11.886 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T10:22:11.916 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 105/164 2024-05-08T10:22:11.995 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T10:22:12.004 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 105/164 2024-05-08T10:22:12.043 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T10:22:12.076 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T10:22:12.178 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T10:22:12.213 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 106/164 2024-05-08T10:22:12.243 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T10:22:12.332 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T10:22:12.371 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T10:22:12.547 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T10:22:12.576 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T10:22:12.656 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T10:22:13.307 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T10:22:13.426 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T10:22:14.677 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T10:22:14.768 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-08T10:22:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T10:22:14.797 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-08T10:22:14.802 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T10:22:14.835 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T10:22:15.156 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T10:22:15.215 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 101/164 2024-05-08T10:22:15.306 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 101/164 2024-05-08T10:22:15.336 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 102/164 2024-05-08T10:22:15.341 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-08T10:22:15.373 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T10:22:15.384 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 108/164 2024-05-08T10:22:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 108/164 2024-05-08T10:22:15.474 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T10:22:15.474 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T10:22:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 109/164 2024-05-08T10:22:15.852 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T10:22:15.877 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 105/164 2024-05-08T10:22:15.940 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 105/164 2024-05-08T10:22:15.970 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 106/164 2024-05-08T10:22:18.245 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-08T10:22:18.283 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-08T10:22:18.824 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-08T10:22:18.862 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 108/164 2024-05-08T10:22:18.957 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 108/164 2024-05-08T10:22:18.957 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T10:22:18.957 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T10:22:18.957 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:18.997 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 109/164 2024-05-08T10:22:27.017 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 109/164 2024-05-08T10:22:27.018 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2024-05-08T10:22:27.018 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2024-05-08T10:22:27.018 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2024-05-08T10:22:27.018 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2024-05-08T10:22:27.018 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2024-05-08T10:22:27.018 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /root 2024-05-08T10:22:27.018 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2024-05-08T10:22:27.018 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:27.191 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 110/164 2024-05-08T10:22:27.207 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 110/164 2024-05-08T10:22:27.207 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:27.208 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T10:22:27.208 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:28.693 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 111/164 2024-05-08T10:22:28.721 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 111/164 2024-05-08T10:22:28.721 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:28.721 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T10:22:28.721 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T10:22:28.721 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T10:22:28.721 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:28.944 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 112/164 2024-05-08T10:22:28.967 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 112/164 2024-05-08T10:22:28.967 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:28.968 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T10:22:28.968 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T10:22:28.968 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T10:22:28.968 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:29.411 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 113/164 2024-05-08T10:22:29.435 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 113/164 2024-05-08T10:22:29.435 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:29.435 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T10:22:29.435 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T10:22:29.435 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T10:22:29.435 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:29.541 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T10:22:29.598 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T10:22:29.653 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T10:22:29.848 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T10:22:29.895 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T10:22:29.973 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T10:22:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T10:22:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T10:22:30.254 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T10:22:30.294 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T10:22:30.330 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T10:22:30.375 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 109/164 2024-05-08T10:22:30.375 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /sys 2024-05-08T10:22:30.375 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /proc 2024-05-08T10:22:30.375 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /mnt 2024-05-08T10:22:30.375 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /var/tmp 2024-05-08T10:22:30.375 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /home 2024-05-08T10:22:30.375 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /root 2024-05-08T10:22:30.375 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /tmp 2024-05-08T10:22:30.375 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:30.547 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 110/164 2024-05-08T10:22:30.563 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 110/164 2024-05-08T10:22:30.563 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:30.564 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T10:22:30.564 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:30.717 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 125/164 2024-05-08T10:22:30.745 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 125/164 2024-05-08T10:22:30.777 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.e 126/164 2024-05-08T10:22:30.838 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b. 127/164 2024-05-08T10:22:30.876 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 128/164 2024-05-08T10:22:31.913 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 128/164 2024-05-08T10:22:31.986 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 129/164 2024-05-08T10:22:32.050 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 111/164 2024-05-08T10:22:32.077 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 111/164 2024-05-08T10:22:32.077 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:32.077 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T10:22:32.077 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T10:22:32.077 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T10:22:32.078 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:32.308 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 112/164 2024-05-08T10:22:32.332 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 112/164 2024-05-08T10:22:32.332 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:32.332 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T10:22:32.332 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T10:22:32.332 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T10:22:32.332 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:32.776 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 113/164 2024-05-08T10:22:32.799 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 113/164 2024-05-08T10:22:32.799 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:32.799 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T10:22:32.800 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T10:22:32.800 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T10:22:32.800 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:32.914 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T10:22:32.956 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 129/164 2024-05-08T10:22:32.971 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T10:22:32.995 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 130/164 2024-05-08T10:22:33.026 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T10:22:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 130/164 2024-05-08T10:22:33.220 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T10:22:33.268 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T10:22:33.275 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el 131/164 2024-05-08T10:22:33.305 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 132/164 2024-05-08T10:22:33.329 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 132/164 2024-05-08T10:22:33.329 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:33.329 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T10:22:33.329 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T10:22:33.329 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T10:22:33.329 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:33.346 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T10:22:33.373 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 133/164 2024-05-08T10:22:33.384 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 133/164 2024-05-08T10:22:33.433 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T10:22:33.481 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 134/164 2024-05-08T10:22:33.535 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 135/164 2024-05-08T10:22:33.591 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T10:22:33.626 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T10:22:33.658 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T10:22:33.685 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T10:22:34.114 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 125/164 2024-05-08T10:22:34.142 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 125/164 2024-05-08T10:22:34.174 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.e 126/164 2024-05-08T10:22:34.236 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b. 127/164 2024-05-08T10:22:34.265 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 128/164 2024-05-08T10:22:34.466 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T10:22:34.500 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 137/164 2024-05-08T10:22:34.523 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 137/164 2024-05-08T10:22:34.524 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:34.524 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T10:22:34.524 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T10:22:34.524 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T10:22:34.524 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:34.567 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gcd693 138/164 2024-05-08T10:22:34.590 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gcd693 138/164 2024-05-08T10:22:34.590 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:34.590 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T10:22:34.590 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:34.634 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 139/164 2024-05-08T10:22:34.658 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 139/164 2024-05-08T10:22:34.658 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:34.658 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T10:22:34.658 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T10:22:34.658 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T10:22:34.658 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:34.960 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 140/164 2024-05-08T10:22:34.983 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 140/164 2024-05-08T10:22:34.983 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:34.983 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T10:22:34.984 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T10:22:34.984 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T10:22:34.984 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:35.308 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 128/164 2024-05-08T10:22:35.350 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 129/164 2024-05-08T10:22:36.316 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 129/164 2024-05-08T10:22:36.342 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 130/164 2024-05-08T10:22:36.455 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 130/164 2024-05-08T10:22:36.612 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el 131/164 2024-05-08T10:22:36.636 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 132/164 2024-05-08T10:22:36.660 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 132/164 2024-05-08T10:22:36.660 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:36.660 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T10:22:36.660 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T10:22:36.660 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T10:22:36.660 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:36.712 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 133/164 2024-05-08T10:22:36.723 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 133/164 2024-05-08T10:22:36.821 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 134/164 2024-05-08T10:22:36.877 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 135/164 2024-05-08T10:22:37.816 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T10:22:37.847 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 137/164 2024-05-08T10:22:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 137/164 2024-05-08T10:22:37.871 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:37.871 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T10:22:37.871 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T10:22:37.871 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T10:22:37.871 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:37.914 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gcd693 138/164 2024-05-08T10:22:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gcd693 138/164 2024-05-08T10:22:37.938 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:37.938 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T10:22:37.938 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:37.990 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 139/164 2024-05-08T10:22:38.013 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 139/164 2024-05-08T10:22:38.013 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:38.013 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T10:22:38.013 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T10:22:38.014 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T10:22:38.014 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:38.316 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 140/164 2024-05-08T10:22:38.339 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 140/164 2024-05-08T10:22:38.339 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:22:38.339 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T10:22:38.340 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T10:22:38.340 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T10:22:38.340 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:39.647 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 141/164 2024-05-08T10:22:39.697 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 142/164 2024-05-08T10:22:39.737 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 143/164 2024-05-08T10:22:39.769 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T10:22:39.796 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T10:22:39.991 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 146/164 2024-05-08T10:22:40.034 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T10:22:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_ 148/164 2024-05-08T10:22:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T10:22:40.140 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T10:22:40.807 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:22:40.846 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:22:40.866 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:22:41.700 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 152/164 2024-05-08T10:22:41.800 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T10:22:41.851 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T10:22:41.940 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T10:22:41.969 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T10:22:41.995 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T10:22:41.995 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T10:22:42.080 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T10:22:42.121 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T10:22:42.121 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T10:22:42.205 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T10:22:42.230 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T10:22:42.236 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:22:42.236 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:22:42.436 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:22:42.436 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T10:22:42.526 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T10:22:42.607 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:22:42.969 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 141/164 2024-05-08T10:22:43.020 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 142/164 2024-05-08T10:22:43.060 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 143/164 2024-05-08T10:22:43.091 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T10:22:43.119 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T10:22:43.314 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 146/164 2024-05-08T10:22:43.356 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T10:22:43.387 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_ 148/164 2024-05-08T10:22:43.416 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T10:22:43.454 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T10:22:44.087 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:22:44.126 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:22:44.146 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:22:44.973 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 152/164 2024-05-08T10:22:45.055 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T10:22:45.102 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T10:22:45.189 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T10:22:45.225 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T10:22:45.251 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T10:22:45.251 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T10:22:45.335 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T10:22:45.377 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T10:22:45.377 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T10:22:45.454 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T10:22:45.477 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T10:22:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:22:45.483 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:22:45.663 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:22:45.663 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T10:22:45.757 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T10:22:45.828 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:22:48.346 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 1/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 2/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 3/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 4/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gcd693 5/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 6/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 7/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 10/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 11/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 12/164 2024-05-08T10:22:48.347 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 14/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_ 15/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 16/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 17/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_6 18/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 19/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 20/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el 21/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9. 22/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_6 23/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 24/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 25/164 2024-05-08T10:22:48.348 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 26/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 27/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 28/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 29/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b. 30/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 31/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 32/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 33/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el 34/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 35/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.e 36/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 37/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 38/164 2024-05-08T10:22:48.349 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 39/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T10:22:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T10:22:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T10:22:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T10:22:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T10:22:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T10:22:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T10:22:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T10:22:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 149/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 151/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T10:22:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T10:22:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T10:22:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T10:22:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T10:22:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T10:22:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T10:22:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T10:22:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T10:22:50.977 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:22:50.977 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:50.977 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T10:22:50.978 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.979 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T10:22:50.980 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.981 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T10:22:50.982 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T10:22:50.983 INFO:teuthology.orchestra.run.smithi163.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T10:22:50.984 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T10:22:50.985 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T10:22:50.986 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T10:22:50.987 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T10:22:50.989 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T10:22:50.989 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.990 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.991 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:50.991 INFO:teuthology.orchestra.run.smithi163.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T10:22:50.991 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T10:22:50.991 INFO:teuthology.orchestra.run.smithi163.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T10:22:50.991 INFO:teuthology.orchestra.run.smithi163.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T10:22:50.991 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T10:22:50.991 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T10:22:50.991 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T10:22:50.992 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:50.992 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-05-08T10:22:51.454 DEBUG:teuthology.parallel:result is None 2024-05-08T10:22:51.524 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:22:51.524 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 1/164 2024-05-08T10:22:51.524 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 2/164 2024-05-08T10:22:51.524 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 3/164 2024-05-08T10:22:51.524 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 4/164 2024-05-08T10:22:51.524 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gcd693 5/164 2024-05-08T10:22:51.524 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 6/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 7/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 10/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 11/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 12/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 14/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_ 15/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 16/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 17/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_6 18/164 2024-05-08T10:22:51.525 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 19/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 20/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el 21/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9. 22/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_6 23/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 24/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 25/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 26/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 27/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 28/164 2024-05-08T10:22:51.526 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 29/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b. 30/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 31/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 32/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 33/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el 34/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 35/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.e 36/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 37/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 38/164 2024-05-08T10:22:51.539 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 39/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T10:22:51.540 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T10:22:51.541 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T10:22:51.542 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T10:22:51.543 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T10:22:51.544 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T10:22:51.545 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T10:22:51.546 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T10:22:51.547 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 149/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 151/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T10:22:51.548 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T10:22:51.549 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T10:22:51.549 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T10:22:51.549 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T10:22:51.549 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T10:22:51.549 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T10:22:51.549 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T10:22:51.549 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T10:22:54.026 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout:Upgraded: 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-05-08T10:22:54.027 INFO:teuthology.orchestra.run.smithi143.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.028 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-08T10:22:54.029 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.030 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T10:22:54.031 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T10:22:54.032 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T10:22:54.033 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T10:22:54.034 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T10:22:54.035 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.036 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T10:22:54.037 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-08T10:22:54.038 INFO:teuthology.orchestra.run.smithi143.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T10:22:54.039 INFO:teuthology.orchestra.run.smithi143.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T10:22:54.039 INFO:teuthology.orchestra.run.smithi143.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T10:22:54.039 INFO:teuthology.orchestra.run.smithi143.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T10:22:54.039 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T10:22:54.039 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T10:22:54.039 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T10:22:54.039 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:54.039 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-05-08T10:22:54.483 DEBUG:teuthology.parallel:result is None 2024-05-08T10:22:54.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-08T10:22:54.628 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T10:22:54.650 INFO:teuthology.orchestra.run.smithi143.stdout:19.0.0-3538.gcd693b0b.el9 2024-05-08T10:22:54.651 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gcd693b0b.el9 2024-05-08T10:22:54.651 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gcd693b0b is installed. 2024-05-08T10:22:54.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-08T10:22:54.793 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T10:22:54.820 INFO:teuthology.orchestra.run.smithi163.stdout:19.0.0-3538.gcd693b0b.el9 2024-05-08T10:22:54.820 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gcd693b0b.el9 2024-05-08T10:22:54.821 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gcd693b0b is installed. 2024-05-08T10:22:54.822 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T10:22:54.823 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:54.823 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T10:22:54.850 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:22:54.850 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T10:22:54.894 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T10:22:54.895 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:54.895 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T10:22:54.920 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T10:22:54.984 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:22:54.984 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T10:22:55.012 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T10:22:55.080 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T10:22:55.080 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:55.081 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T10:22:55.105 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T10:22:55.169 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:22:55.170 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T10:22:55.197 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T10:22:55.264 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T10:22:55.264 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:55.264 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T10:22:55.289 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T10:22:55.353 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:22:55.354 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T10:22:55.380 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T10:22:55.446 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T10:22:55.540 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T10:22:55.540 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2024-05-08T10:22:55.543 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2024-05-08T10:22:55.568 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T10:22:55.568 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T10:22:55.608 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T10:22:55.633 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T10:22:55.634 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T10:22:55.673 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T10:22:55.711 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-08T10:22:55.711 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-08T10:22:55.712 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-08T10:22:55.712 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:55.712 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T10:22:55.752 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T10:22:55.857 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T10:22:55.882 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:22:55.882 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T10:22:55.898 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T10:22:56.005 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T10:22:56.036 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T10:22:56.036 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T10:22:56.036 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400', 'branch': 'wip-jcollin-testing-07052024', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush}', 'email': 'jcollin@redhat.com', 'first_in_suite': False, 'job_id': '7697400', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-jcollin-testing-07052024'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'origin-jcollin-testing', 'sha1': '486398014c80883074e0469d9aa7f4ebb8fab0b6'}}, 'owner': 'scheduled_jcollin@teuthology', 'priority': 2, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'origin-jcollin-testing', 'suite_path': '/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/joscollin/ceph.git', 'suite_sha1': '486398014c80883074e0469d9aa7f4ebb8fab0b6', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWJ+hlvCU+RQbiB8D6Z1ZWGpb72LvgWYaQjhbEZDtpE7a7pRiDDzNH8grax0hvyIE62BmUzBe/CEppoYCNoSeM=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdRH89PE8AUm+BKZpFPskz3c4EU7ry/ujdoPhzopSXLxvYCUpu/Sa8LOD1f4/eaGfFZdzoFdexE5wuWK8cEA2k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_flush']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_10:01:15', 'tube': 'smithi', 'user': 'jcollin', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T10:22:56.037 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T10:22:56.039 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T10:22:56.087 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T10:22:56.095 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T10:22:56.152 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:56.153 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T10:22:56.174 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T10:22:56.174 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-05-08T10:22:56.229 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T10:22:56.229 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:22:56.229 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-08T10:22:56.229 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:22:56.229 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:22:56.229 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-05-08 10:22:46.210603801 +0000 2024-05-08T10:22:56.230 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-05-08 10:20:41.359153009 +0000 2024-05-08T10:22:56.230 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-05-08 10:20:41.359153009 +0000 2024-05-08T10:22:56.230 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-05-08 10:20:41.359153009 +0000 2024-05-08T10:22:56.230 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T10:22:56.292 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-05-08T10:22:56.293 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-05-08T10:22:56.293 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000263095 s, 1.9 MB/s 2024-05-08T10:22:56.294 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T10:22:56.350 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-05-08T10:22:56.405 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T10:22:56.405 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:22:56.406 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-08T10:22:56.406 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:22:56.406 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:22:56.406 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-05-08 10:22:46.211603775 +0000 2024-05-08T10:22:56.406 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-05-08 10:20:41.697144175 +0000 2024-05-08T10:22:56.406 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-05-08 10:20:41.697144175 +0000 2024-05-08T10:22:56.406 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-05-08 10:20:41.697144175 +0000 2024-05-08T10:22:56.406 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T10:22:56.469 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-05-08T10:22:56.469 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-05-08T10:22:56.469 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000191223 s, 2.7 MB/s 2024-05-08T10:22:56.470 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T10:22:56.526 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-05-08T10:22:56.582 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T10:22:56.582 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:22:56.582 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-08T10:22:56.582 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:22:56.582 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:22:56.582 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-05-08 10:22:46.211603775 +0000 2024-05-08T10:22:56.583 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-05-08 10:20:42.029135497 +0000 2024-05-08T10:22:56.583 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-05-08 10:20:42.029135497 +0000 2024-05-08T10:22:56.583 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-05-08 10:20:42.029135497 +0000 2024-05-08T10:22:56.583 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T10:22:56.644 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-05-08T10:22:56.645 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-05-08T10:22:56.645 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000197344 s, 2.6 MB/s 2024-05-08T10:22:56.646 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T10:22:56.702 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-05-08T10:22:56.757 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T10:22:56.757 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:22:56.757 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-08T10:22:56.757 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:22:56.757 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:22:56.758 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-05-08 10:22:46.212603748 +0000 2024-05-08T10:22:56.758 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-05-08 10:20:42.365126714 +0000 2024-05-08T10:22:56.758 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-05-08 10:20:42.365126714 +0000 2024-05-08T10:22:56.758 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-05-08 10:20:42.365126714 +0000 2024-05-08T10:22:56.758 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T10:22:56.820 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-05-08T10:22:56.820 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-05-08T10:22:56.820 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000208379 s, 2.5 MB/s 2024-05-08T10:22:56.821 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T10:22:56.878 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:22:56.878 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:22:56.878 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T10:22:56.895 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T10:22:56.895 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2024-05-08T10:22:56.951 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T10:22:56.951 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:22:56.952 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-08T10:22:56.952 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:22:56.952 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:22:56.952 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-05-08 10:22:42.982641123 +0000 2024-05-08T10:22:56.952 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-05-08 10:20:40.948397384 +0000 2024-05-08T10:22:56.952 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-05-08 10:20:40.948397384 +0000 2024-05-08T10:22:56.952 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-05-08 10:20:40.948397384 +0000 2024-05-08T10:22:56.952 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T10:22:57.016 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-05-08T10:22:57.016 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-05-08T10:22:57.016 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.0002002 s, 2.6 MB/s 2024-05-08T10:22:57.017 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T10:22:57.075 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2024-05-08T10:22:57.131 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T10:22:57.131 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:22:57.131 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-08T10:22:57.131 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:22:57.131 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:22:57.131 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-05-08 10:22:42.983641101 +0000 2024-05-08T10:22:57.131 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-05-08 10:20:41.289389816 +0000 2024-05-08T10:22:57.131 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-05-08 10:20:41.289389816 +0000 2024-05-08T10:22:57.131 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-05-08 10:20:41.289389816 +0000 2024-05-08T10:22:57.132 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T10:22:57.195 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-05-08T10:22:57.195 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-05-08T10:22:57.195 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000190966 s, 2.7 MB/s 2024-05-08T10:22:57.196 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T10:22:57.253 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2024-05-08T10:22:57.309 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T10:22:57.309 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:22:57.309 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-08T10:22:57.309 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:22:57.309 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:22:57.309 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-05-08 10:22:42.983641101 +0000 2024-05-08T10:22:57.309 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-05-08 10:20:41.624382381 +0000 2024-05-08T10:22:57.309 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-05-08 10:20:41.624382381 +0000 2024-05-08T10:22:57.309 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-05-08 10:20:41.624382381 +0000 2024-05-08T10:22:57.310 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T10:22:57.373 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-05-08T10:22:57.373 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-05-08T10:22:57.373 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000182921 s, 2.8 MB/s 2024-05-08T10:22:57.374 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T10:22:57.430 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2024-05-08T10:22:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T10:22:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:22:57.487 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-08T10:22:57.487 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:22:57.487 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:22:57.487 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-05-08 10:22:42.983641101 +0000 2024-05-08T10:22:57.487 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-05-08 10:20:41.982374435 +0000 2024-05-08T10:22:57.487 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-05-08 10:20:41.982374435 +0000 2024-05-08T10:22:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-05-08 10:20:41.982374435 +0000 2024-05-08T10:22:57.488 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T10:22:57.550 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-05-08T10:22:57.550 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-05-08T10:22:57.551 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000206266 s, 2.5 MB/s 2024-05-08T10:22:57.552 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T10:22:57.608 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:22:57.608 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T10:22:57.608 INFO:tasks.ceph:Generating config... 2024-05-08T10:22:57.610 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-08T10:22:57.610 INFO:tasks.ceph:[client] debug client = 20 2024-05-08T10:22:57.610 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T10:22:57.610 INFO:tasks.ceph:[client] pid file = 2024-05-08T10:22:57.610 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-08T10:22:57.610 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-08T10:22:57.610 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-08T10:22:57.610 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-08T10:22:57.610 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-08T10:22:57.610 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-08T10:22:57.610 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-08T10:22:57.610 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-08T10:22:57.610 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-08T10:22:57.611 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-08T10:22:57.611 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T10:22:57.611 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T10:22:57.612 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-08T10:22:57.613 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T10:22:57.613 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T10:22:57.660 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T10:22:57.663 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T10:22:57.707 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T10:22:57.774 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.143'), ('mon.b', '172.21.15.163'), ('mon.c', '[v2:172.21.15.163:3301,v1:172.21.15.163:6790]')] 2024-05-08T10:22:57.775 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.143,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-08T10:22:57.775 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:57.776 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T10:22:57.829 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.143 --add b 172.21.15.163 --addv c '[v2:172.21.15.163:3301,v1:172.21.15.163:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:22:57.915 INFO:teuthology.orchestra.run.smithi143.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:22:57.915 INFO:teuthology.orchestra.run.smithi143.stdout:monmaptool: generated fsid aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64 2024-05-08T10:22:57.915 INFO:teuthology.orchestra.run.smithi143.stdout:setting min_mon_release = quincy 2024-05-08T10:22:57.915 INFO:teuthology.orchestra.run.smithi143.stdout:epoch 0 2024-05-08T10:22:57.915 INFO:teuthology.orchestra.run.smithi143.stdout:fsid aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64 2024-05-08T10:22:57.915 INFO:teuthology.orchestra.run.smithi143.stdout:last_changed 2024-05-08T10:22:57.931035+0000 2024-05-08T10:22:57.916 INFO:teuthology.orchestra.run.smithi143.stdout:created 2024-05-08T10:22:57.931035+0000 2024-05-08T10:22:57.916 INFO:teuthology.orchestra.run.smithi143.stdout:min_mon_release 17 (quincy) 2024-05-08T10:22:57.916 INFO:teuthology.orchestra.run.smithi143.stdout:election_strategy: 1 2024-05-08T10:22:57.916 INFO:teuthology.orchestra.run.smithi143.stdout:0: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.a 2024-05-08T10:22:57.916 INFO:teuthology.orchestra.run.smithi143.stdout:1: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-05-08T10:22:57.916 INFO:teuthology.orchestra.run.smithi143.stdout:2: [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] mon.c 2024-05-08T10:22:57.916 INFO:teuthology.orchestra.run.smithi143.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T10:22:57.918 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T10:22:57.933 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64... 2024-05-08T10:22:57.934 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T10:22:57.976 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T10:22:58.017 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-05-08T10:22:58.017 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-05-08T10:22:58.017 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T10:22:58.017 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-05-08T10:22:58.017 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.017 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-05-08T10:22:58.017 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.017 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.018 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-05-08T10:22:58.019 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-05-08T10:22:58.020 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.143,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]" 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on skipped message = False 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-05-08T10:22:58.021 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-05-08T10:22:58.022 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-05-08T10:22:58.022 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.022 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-05-08T10:22:58.022 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-05-08T10:22:58.022 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.022 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-05-08T10:22:58.022 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-05-08T10:22:58.022 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.023 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: bdev async discard = True 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: bdev enable discard = True 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore allocator = bitmap 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-05-08T10:22:58.024 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-05-08T10:22:58.025 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 1/20 2024-05-08T10:22:58.025 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 1/20 2024-05-08T10:22:58.025 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-05-08T10:22:58.025 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-05-08T10:22:58.025 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 4/10 2024-05-08T10:22:58.025 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T10:22:58.025 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-05-08T10:22:58.025 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-05-08T10:22:58.025 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-05-08T10:22:58.026 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-05-08T10:22:58.027 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.028 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: mon down mkfs grace = 300 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: mon op complaint time = 120 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T10:22:58.029 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 600 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = "" 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-05-08T10:22:58.030 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-05-08T10:22:58.031 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-05-08T10:22:58.031 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-05-08T10:22:58.031 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-05-08T10:22:58.031 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2024-05-08T10:22:58.031 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds = 20 2024-05-08T10:22:58.031 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds balancer = 20 2024-05-08T10:22:58.031 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-05-08T10:22:58.031 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug frag = True 2024-05-08T10:22:58.031 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug scatterstat = True 2024-05-08T10:22:58.032 INFO:teuthology.orchestra.run.smithi143.stdout: mds op complaint time = 180 2024-05-08T10:22:58.032 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = True 2024-05-08T10:22:58.032 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-05-08T10:22:58.032 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-05-08T10:22:58.032 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2024-05-08T10:22:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T10:22:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.143,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]" 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on skipped message = False 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.038 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug trim objects = true 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: bdev async discard = True 2024-05-08T10:22:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: bdev enable discard = True 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore allocator = bitmap 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 1/20 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 1/20 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 4/10 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2024-05-08T10:22:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.042 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T10:22:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: mon down mkfs grace = 300 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: mon op complaint time = 120 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2024-05-08T10:22:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: client mount timeout = 600 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = "" 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-05-08T10:22:58.045 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout:[mds] 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds = 20 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds balancer = 20 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug frag = True 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug scatterstat = True 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: mds op complaint time = 180 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: mds verify scatter = True 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2024-05-08T10:22:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2024-05-08T10:22:58.047 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T10:22:58.047 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T10:22:58.129 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T10:22:58.129 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:58.129 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T10:22:58.144 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:58.145 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T10:22:58.200 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:22:58.200 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:58.200 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T10:22:58.200 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T10:22:58.274 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:22:58.274 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:22:58.329 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:22:58.329 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:22:58.330 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T10:22:58.330 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T10:22:58.366 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:22:58.366 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:22:58.423 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T10:22:58.423 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T10:22:58.423 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T10:22:58.473 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T10:22:58.476 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T10:22:58.535 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T10:22:58.537 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T10:22:58.538 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T10:22:58.589 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T10:22:58.591 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-08T10:22:58.616 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T10:22:58.706 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T10:22:58.709 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-08T10:22:58.733 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T10:22:58.784 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T10:22:58.787 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-08T10:22:58.811 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T10:22:58.903 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T10:22:58.905 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-08T10:22:58.930 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T10:22:58.931 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T10:22:58.971 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T10:22:58.984 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-08T10:22:59.064 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-08T10:22:59.077 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-08T10:22:59.119 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-08T10:22:59.132 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-08T10:22:59.213 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-08T10:22:59.226 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T10:22:59.226 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T10:22:59.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T10:22:59.250 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:22:59.251 INFO:tasks.ceph:role: osd.0 2024-05-08T10:22:59.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:22:59.251 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T10:22:59.323 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:22:59.323 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:22:59.323 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:22:59.324 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:22:59.324 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:22:59.324 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:22:59.324 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:22:59.324 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:22:59.324 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:22:59.324 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:22:59.809 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-05-08T10:22:59.811 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-05-08T10:22:59.812 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T10:22:59.934 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T10:22:59.968 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T10:23:00.033 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:23:00.033 INFO:tasks.ceph:role: osd.1 2024-05-08T10:23:00.033 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:23:00.033 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:23:00.106 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:23:00.561 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-05-08T10:23:00.563 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-05-08T10:23:00.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T10:23:00.637 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T10:23:00.706 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T10:23:00.772 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:23:00.772 INFO:tasks.ceph:role: osd.2 2024-05-08T10:23:00.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:23:00.772 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T10:23:00.844 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:23:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:23:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:23:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:23:00.845 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:23:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:23:00.845 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:23:00.845 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:23:00.845 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:23:00.845 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:23:01.331 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-05-08T10:23:01.333 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-05-08T10:23:01.333 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T10:23:01.426 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T10:23:01.456 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T10:23:01.522 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:23:01.522 INFO:tasks.ceph:role: osd.3 2024-05-08T10:23:01.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:23:01.522 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T10:23:01.594 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:23:01.594 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:23:01.594 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:23:01.594 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:23:01.594 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:23:01.594 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:23:01.594 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:23:01.594 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:23:01.594 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:23:01.595 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:23:02.090 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-05-08T10:23:02.092 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-05-08T10:23:02.093 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T10:23:02.223 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T10:23:02.256 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:02.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:02.375+0000 7f0a92025640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T10:23:02.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:02.377+0000 7f0a92025640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T10:23:02.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:02.377+0000 7f0a92025640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T10:23:02.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:02.377+0000 7f0a92025640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T10:23:02.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:02.377+0000 7f0a92025640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T10:23:02.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:02.381+0000 7f0a92025640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T10:23:05.225 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T10:23:05.254 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:05.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:05.360+0000 7fac8c818640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T10:23:05.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:05.360+0000 7fac8c818640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T10:23:05.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:05.360+0000 7fac8c818640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T10:23:05.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:05.360+0000 7fac8c818640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T10:23:05.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:05.360+0000 7fac8c818640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T10:23:05.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:05.361+0000 7fac8c818640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T10:23:08.201 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T10:23:08.231 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:08.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:08.338+0000 7f63a4843640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T10:23:08.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:08.338+0000 7f63a4843640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T10:23:08.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:08.338+0000 7f63a4843640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T10:23:08.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:08.338+0000 7f63a4843640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T10:23:08.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:08.338+0000 7f63a4843640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T10:23:08.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:08.338+0000 7f63a4843640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T10:23:11.163 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T10:23:11.189 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:11.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:11.288+0000 7f20aba1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T10:23:11.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:11.288+0000 7f20aba1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T10:23:11.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:11.288+0000 7f20aba1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T10:23:11.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:11.288+0000 7f20aba1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T10:23:11.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:11.288+0000 7f20aba1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T10:23:11.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:11.289+0000 7f20aba1a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T10:23:14.128 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T10:23:14.158 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T10:23:14.190 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:23:14.190 INFO:tasks.ceph:role: osd.4 2024-05-08T10:23:14.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:23:14.191 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T10:23:14.268 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:23:14.268 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:23:14.269 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:23:14.269 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:23:14.269 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:23:14.269 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:23:14.269 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:23:14.269 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:23:14.269 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:23:14.269 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:23:14.770 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-05-08T10:23:14.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-05-08T10:23:14.773 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T10:23:14.891 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T10:23:14.928 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T10:23:14.996 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:23:14.996 INFO:tasks.ceph:role: osd.5 2024-05-08T10:23:14.996 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:23:14.996 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:23:15.071 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:23:15.534 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-05-08T10:23:15.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-05-08T10:23:15.536 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T10:23:15.633 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T10:23:15.665 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T10:23:15.732 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:23:15.733 INFO:tasks.ceph:role: osd.6 2024-05-08T10:23:15.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:23:15.733 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T10:23:15.807 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:23:15.807 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:23:15.807 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:23:15.807 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:23:15.807 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:23:15.807 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:23:15.807 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:23:15.807 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:23:15.808 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:23:15.808 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:23:16.292 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-05-08T10:23:16.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-05-08T10:23:16.294 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T10:23:16.441 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T10:23:16.473 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T10:23:16.541 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:23:16.541 INFO:tasks.ceph:role: osd.7 2024-05-08T10:23:16.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:23:16.542 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T10:23:16.615 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:23:16.615 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:23:16.615 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:23:16.615 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:23:16.615 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:23:16.615 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:23:16.615 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:23:16.615 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:23:16.616 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:23:16.616 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:23:17.122 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-05-08T10:23:17.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-05-08T10:23:17.125 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T10:23:17.247 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T10:23:17.279 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:17.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:17.406+0000 7f1b30a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T10:23:17.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:17.406+0000 7f1b30a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T10:23:17.392 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:17.406+0000 7f1b30a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T10:23:17.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:17.407+0000 7f1b30a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T10:23:17.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:17.407+0000 7f1b30a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T10:23:17.393 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:17.407+0000 7f1b30a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T10:23:20.241 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T10:23:20.269 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:20.356 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:20.370+0000 7fd8bf85f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T10:23:20.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:20.370+0000 7fd8bf85f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T10:23:20.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:20.370+0000 7fd8bf85f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T10:23:20.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:20.371+0000 7fd8bf85f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T10:23:20.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:20.371+0000 7fd8bf85f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T10:23:20.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:20.371+0000 7fd8bf85f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T10:23:23.198 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T10:23:23.227 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:23.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:23.331+0000 7f13a6c2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T10:23:23.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:23.331+0000 7f13a6c2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T10:23:23.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:23.331+0000 7f13a6c2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T10:23:23.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:23.331+0000 7f13a6c2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T10:23:23.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:23.331+0000 7f13a6c2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T10:23:23.317 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:23.332+0000 7f13a6c2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T10:23:26.038 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:23:26.041 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:23:26.168 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T10:23:26.234 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:26.320 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:26.335+0000 7fd6b57a7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T10:23:26.320 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:26.335+0000 7fd6b57a7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T10:23:26.321 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:26.335+0000 7fd6b57a7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T10:23:26.321 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:26.335+0000 7fd6b57a7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T10:23:26.321 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:26.335+0000 7fd6b57a7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T10:23:26.321 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:26.336+0000 7fd6b57a7640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T10:23:29.172 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T10:23:29.200 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T10:23:29.201 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:29.201 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T10:23:29.231 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:29.231 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-08T10:23:29.300 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:29.300 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-08T10:23:29.369 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:29.369 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T10:23:29.436 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:29.436 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T10:23:29.502 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:29.502 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T10:23:29.569 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:29.570 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T10:23:29.635 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:29.635 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T10:23:29.666 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:29.666 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-08T10:23:29.735 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:29.735 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-08T10:23:29.803 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:29.803 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T10:23:29.870 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:29.870 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T10:23:29.936 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:29.936 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T10:23:30.001 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:30.002 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T10:23:30.067 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:30.067 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T10:23:30.084 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:30.084 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-08T10:23:30.141 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:30.141 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-08T10:23:30.157 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:30.157 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-08T10:23:30.213 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T10:23:30.213 DEBUG:teuthology.orchestra.run.smithi143:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T10:23:30.215 DEBUG:teuthology.orchestra.run.smithi163:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.y] 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCCUjtm2ccwHRAA2cHU4vUrwcjyH3ZF/MF3tQ== 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCCUjtmj/oRJBAAj+SWEE5sIjviPtkhZfAAaA== 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCCUjtmK/sPKxAA0RlQJoXzQU+ywnp7L+dZuA== 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.0] 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCGUjtmwIVzFhAA5VMtMoa0sTgPOOrmvTFmKQ== 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.1] 2024-05-08T10:23:30.257 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCJUjtm13uIFRAAyy86yKW7i31iYf0PcZ1XVQ== 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.2] 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCMUjtmUjw1FBAA6TeAgklzJnOhJPcsdFfUQg== 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.3] 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCPUjtm7utKERAAsxmGo0sHDeT2rpYzWB7sfg== 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.x] 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCCUjtmKQraIBAA27PzcLr3jA9+8jcK8sKkbQ== 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCCUjtmx7e3LxAAxDUVIwwSMbU717+Y5cn0dw== 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCCUjtmWjTHNhAAbB4Co/CoATQrtp69+Qb3XQ== 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.4] 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCVUjtmj1xMGBAAvWd7uu1KPpXRzA1qSCT0Xg== 2024-05-08T10:23:30.258 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.5] 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCYUjtmQzsnFhAANCsDkfby0WAfsap11g/ZTQ== 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.6] 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCbUjtmkLfQExAAIGWYBjWLxzjzrzzULenGpA== 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.7] 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCeUjtmhGELFBAACMPSNYoWdfRVwS/akhH6qA== 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCCUjtm9n3YOhAAq9VPDZFRf917El5YIeO+8A== 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout:[client.2] 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCDUjtmRCrOBBAAdUhEV0UVUb/Po5cOAJnvyQ== 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout:[client.1] 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCDUjtmD+oMCBAAB2Gf8dQIWjpzb23VM2eiUw== 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout:[client.3] 2024-05-08T10:23:30.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCDUjtmOoynDRAAa3AYJUsalt9qn0xrrL7GnQ== 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.y] 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCUjtm2ccwHRAA2cHU4vUrwcjyH3ZF/MF3tQ== 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCUjtmj/oRJBAAj+SWEE5sIjviPtkhZfAAaA== 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCUjtmK/sPKxAA0RlQJoXzQU+ywnp7L+dZuA== 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.0] 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCGUjtmwIVzFhAA5VMtMoa0sTgPOOrmvTFmKQ== 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.1] 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCJUjtm13uIFRAAyy86yKW7i31iYf0PcZ1XVQ== 2024-05-08T10:23:30.277 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.2] 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCMUjtmUjw1FBAA6TeAgklzJnOhJPcsdFfUQg== 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.3] 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCPUjtm7utKERAAsxmGo0sHDeT2rpYzWB7sfg== 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.x] 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCUjtmKQraIBAA27PzcLr3jA9+8jcK8sKkbQ== 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCUjtmx7e3LxAAxDUVIwwSMbU717+Y5cn0dw== 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCUjtmWjTHNhAAbB4Co/CoATQrtp69+Qb3XQ== 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.4] 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCVUjtmj1xMGBAAvWd7uu1KPpXRzA1qSCT0Xg== 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.5] 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCYUjtmQzsnFhAANCsDkfby0WAfsap11g/ZTQ== 2024-05-08T10:23:30.278 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.6] 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCbUjtmkLfQExAAIGWYBjWLxzjzrzzULenGpA== 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.7] 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCeUjtmhGELFBAACMPSNYoWdfRVwS/akhH6qA== 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCCUjtm9n3YOhAAq9VPDZFRf917El5YIeO+8A== 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout:[client.2] 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCDUjtmRCrOBBAAdUhEV0UVUb/Po5cOAJnvyQ== 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout:[client.1] 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCDUjtmD+oMCBAAB2Gf8dQIWjpzb23VM2eiUw== 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout:[client.3] 2024-05-08T10:23:30.279 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCDUjtmOoynDRAAa3AYJUsalt9qn0xrrL7GnQ== 2024-05-08T10:23:30.280 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T10:23:30.304 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T10:23:30.372 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:23:30.374 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:23:30.428 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:23:30.430 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:23:30.484 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.536 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.539 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.589 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.591 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.642 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.644 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T10:23:30.697 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T10:23:30.747 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:23:30.750 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:23:30.804 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:23:30.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:23:30.859 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.913 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.915 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.967 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:30.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:31.020 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:31.022 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:23:31.073 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:23:31.076 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:23:31.129 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:23:31.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:23:31.185 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:23:31.188 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:23:31.241 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:23:31.243 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:23:31.297 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T10:23:31.298 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T10:23:31.323 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T10:23:31.419 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T10:23:31.444 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T10:23:31.469 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T10:23:31.566 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T10:23:31.591 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T10:23:31.656 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T10:23:31.754 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T10:23:31.779 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:31.781 DEBUG:teuthology.orchestra.run.smithi163:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:23:31.834 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T10:23:31.835 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T10:23:31.835 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T10:23:31.838 INFO:tasks.ceph.mon.a:Started 2024-05-08T10:23:31.838 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T10:23:31.838 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T10:23:31.877 INFO:tasks.ceph.mon.b:Started 2024-05-08T10:23:31.878 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T10:23:31.878 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T10:23:31.880 INFO:tasks.ceph.mon.c:Started 2024-05-08T10:23:31.880 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T10:23:31.880 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T10:23:31.880 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T10:23:31.884 INFO:tasks.ceph.mgr.y:Started 2024-05-08T10:23:31.885 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T10:23:31.885 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T10:23:31.886 INFO:tasks.ceph.mgr.x:Started 2024-05-08T10:23:31.887 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T10:23:31.887 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T10:23:31.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.001+0000 7fd7b8789640 1 Processor -- start 2024-05-08T10:23:31.987 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.001+0000 7fd7b8789640 1 -- start start 2024-05-08T10:23:31.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b8789640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd7b01607d0 0x7fd7b00b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:31.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b8789640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd7b00d1270 0x7fd7b00d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:31.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b8789640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b015d580 con 0x7fd7b01603f0 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b8789640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b00d1c00 con 0x7fd7b00d1270 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b8789640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b00b4e70 con 0x7fd7b01607d0 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b6d26640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd7b00d1270 0x7fd7b00d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b6d26640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd7b00d1270 0x7fd7b00d16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60992/0 (socket says 172.21.15.143:60992) 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b6d26640 1 -- 172.21.15.143:0/2468084371 learned_addr learned my addr 172.21.15.143:0/2468084371 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b6d26640 1 -- 172.21.15.143:0/2468084371 >> v2:172.21.15.143:3300/0 conn(0x7fd7b00d1270 msgr2=0x7fd7b00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b6d26640 1 -- 172.21.15.143:0/2468084371 >> v2:172.21.15.143:3300/0 conn(0x7fd7b00d1270 msgr2=0x7fd7b00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b6d26640 1 --2- 172.21.15.143:0/2468084371 >> v2:172.21.15.143:3300/0 conn(0x7fd7b00d1270 0x7fd7b00d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b6d26640 1 --2- 172.21.15.143:0/2468084371 >> v2:172.21.15.143:3300/0 conn(0x7fd7b00d1270 0x7fd7b00d16c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b5d24640 1 --2- 172.21.15.143:0/2468084371 >> v2:172.21.15.163:3300/0 conn(0x7fd7b01607d0 0x7fd7b00b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b5d24640 1 -- 172.21.15.143:0/2468084371 >> v2:172.21.15.163:3300/0 conn(0x7fd7b01607d0 msgr2=0x7fd7b00b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b5d24640 1 -- 172.21.15.143:0/2468084371 >> v2:172.21.15.163:3300/0 conn(0x7fd7b01607d0 msgr2=0x7fd7b00b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b5d24640 1 --2- 172.21.15.143:0/2468084371 >> v2:172.21.15.163:3300/0 conn(0x7fd7b01607d0 0x7fd7b00b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T10:23:31.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.002+0000 7fd7b5d24640 1 --2- 172.21.15.143:0/2468084371 >> v2:172.21.15.163:3300/0 conn(0x7fd7b01607d0 0x7fd7b00b5f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T10:23:32.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137129317 0 0) 0x7fd7b015d580 con 0x7fd7b01603f0 2024-05-08T10:23:32.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd79c003520 con 0x7fd7b01603f0 2024-05-08T10:23:32.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1860580364 0 0) 0x7fd79c003520 con 0x7fd7b01603f0 2024-05-08T10:23:32.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 >> v2:172.21.15.163:3300/0 conn(0x7fd7b01607d0 msgr2=0x7fd7b00b5f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T10:23:32.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 --2- 172.21.15.143:0/2468084371 >> v2:172.21.15.163:3300/0 conn(0x7fd7b01607d0 0x7fd7b00b5f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 >> v2:172.21.15.143:3300/0 conn(0x7fd7b00d1270 msgr2=0x7fd7b00d16c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T10:23:32.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 --2- 172.21.15.143:0/2468084371 >> v2:172.21.15.143:3300/0 conn(0x7fd7b00d1270 0x7fd7b00d16c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b00b5150 con 0x7fd7b01603f0 2024-05-08T10:23:32.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7fd7ac0016f0 con 0x7fd7b01603f0 2024-05-08T10:23:32.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 >> v1:172.21.15.163:6789/0 conn(0x7fd7b01603f0 legacy=0x7fd7b015ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd79c003a50 0x7fd79c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.156+0000 7fd7b5523640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd79c004800 0x7fd79c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b5523640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c0051c0 0x7fd79c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00d1c00 con 0x7fd79c003a50 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00b4e70 con 0x7fd79c0051c0 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c00c170 con 0x7fd79c004800 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b6525640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd79c003a50 0x7fd79c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b6d26640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c0051c0 0x7fd79c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b5d24640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd79c004800 0x7fd79c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b6525640 1 -- 172.21.15.143:0/2468084371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd79c004800 msgr2=0x7fd79c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b6525640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd79c004800 0x7fd79c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b6525640 1 -- 172.21.15.143:0/2468084371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c0051c0 msgr2=0x7fd79c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b6525640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c0051c0 0x7fd79c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b6525640 1 -- 172.21.15.143:0/2468084371 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c003520 con 0x7fd79c003a50 2024-05-08T10:23:32.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.157+0000 7fd7b6d26640 1 -- 172.21.15.143:0/2468084371 reap_dead start 2024-05-08T10:23:32.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.158+0000 7fd7b6525640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd79c003a50 0x7fd79c003e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c190 tx=0x7fd79c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff7a28ad5c582fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:32.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.158+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac036070 con 0x7fd79c003a50 2024-05-08T10:23:32.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.158+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac007250 con 0x7fd79c003a50 2024-05-08T10:23:32.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.158+0000 7fd7b5523640 1 -- 172.21.15.143:0/2468084371 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac007c60 con 0x7fd79c003a50 2024-05-08T10:23:32.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.159+0000 7fd7b8789640 1 -- 172.21.15.143:0/2468084371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd79c003a50 msgr2=0x7fd79c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.159+0000 7fd7b8789640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd79c003a50 0x7fd79c003e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c190 tx=0x7fd79c005830 comp rx=0 tx=0).stop 2024-05-08T10:23:32.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.159+0000 7fd7b8789640 1 -- 172.21.15.143:0/2468084371 shutdown_connections 2024-05-08T10:23:32.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.159+0000 7fd7b8789640 1 --2- 172.21.15.143:0/2468084371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd79c003a50 0x7fd79c003e70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.159+0000 7fd7b8789640 1 -- 172.21.15.143:0/2468084371 >> 172.21.15.143:0/2468084371 conn(0x7fd7b006c500 msgr2=0x7fd7b006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:32.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.159+0000 7fd7b8789640 1 -- 172.21.15.143:0/2468084371 shutdown_connections 2024-05-08T10:23:32.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.159+0000 7fd7b8789640 1 -- 172.21.15.143:0/2468084371 wait complete. 2024-05-08T10:23:32.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.161+0000 7fd7b8789640 1 Processor -- start 2024-05-08T10:23:32.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.161+0000 7fd7b8789640 1 -- start start 2024-05-08T10:23:32.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.161+0000 7fd7b8789640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c003a50 0x7fd7b0149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.161+0000 7fd7b8789640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd7b014a4c0 0x7fd7b0152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.161+0000 7fd7b8789640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7b006f500 0x7fd7b006f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.161+0000 7fd7b8789640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00b59f0 con 0x7fd7b006f500 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.161+0000 7fd7b8789640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00b5710 con 0x7fd79c003a50 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.161+0000 7fd7b8789640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b00d16c0 con 0x7fd7b014a4c0 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6525640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c003a50 0x7fd7b0149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6d26640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7b006f500 0x7fd7b006f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b5d24640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd7b014a4c0 0x7fd7b0152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6525640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c003a50 0x7fd7b0149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:46558/0 (socket says 172.21.15.143:46558) 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6525640 1 -- 172.21.15.143:0/3812870998 learned_addr learned my addr 172.21.15.143:0/3812870998 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6d26640 1 -- 172.21.15.143:0/3812870998 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd7b014a4c0 msgr2=0x7fd7b0152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6d26640 1 --2- 172.21.15.143:0/3812870998 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd7b014a4c0 0x7fd7b0152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6d26640 1 -- 172.21.15.143:0/3812870998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c003a50 msgr2=0x7fd7b0149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6d26640 1 --2- 172.21.15.143:0/3812870998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c003a50 0x7fd7b0149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6d26640 1 -- 172.21.15.143:0/3812870998 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b0151cf0 con 0x7fd7b006f500 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b6d26640 1 --2- 172.21.15.143:0/3812870998 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7b006f500 0x7fd7b006f990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00d0cf0 tx=0x7fd7a8010510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7a2ffd640 1 -- 172.21.15.143:0/3812870998 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8010d70 con 0x7fd7b006f500 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b8789640 1 -- 172.21.15.143:0/3812870998 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b0151fd0 con 0x7fd7b006f500 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.162+0000 7fd7b8789640 1 -- 172.21.15.143:0/3812870998 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b0152590 con 0x7fd7b006f500 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.163+0000 7fd7a2ffd640 1 -- 172.21.15.143:0/3812870998 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a801b070 con 0x7fd7b006f500 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.163+0000 7fd7a2ffd640 1 -- 172.21.15.143:0/3812870998 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a800bb10 con 0x7fd7b006f500 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.163+0000 7fd7a2ffd640 1 -- 172.21.15.143:0/3812870998 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd7a8014050 con 0x7fd7b006f500 2024-05-08T10:23:32.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.163+0000 7fd7a2ffd640 1 -- 172.21.15.143:0/3812870998 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd7a8016480 con 0x7fd7b006f500 2024-05-08T10:23:32.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.163+0000 7fd7b8789640 1 -- 172.21.15.143:0/3812870998 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd798005290 con 0x7fd7b006f500 2024-05-08T10:23:32.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.165+0000 7fd7a2ffd640 1 -- 172.21.15.143:0/3812870998 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd7a8012040 con 0x7fd7b006f500 2024-05-08T10:23:32.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.232+0000 7fd7b8789640 1 -- 172.21.15.143:0/3812870998 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd798005850 con 0x7fd7b006f500 2024-05-08T10:23:32.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.234+0000 7fd7a2ffd640 1 -- 172.21.15.143:0/3812870998 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fd7a800d0d0 con 0x7fd7b006f500 2024-05-08T10:23:32.219 INFO:teuthology.orchestra.run.smithi143.stderr:adjusted tunables profile to default 2024-05-08T10:23:32.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.235+0000 7fd7b8789640 1 -- 172.21.15.143:0/3812870998 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7b006f500 msgr2=0x7fd7b006f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.235+0000 7fd7b8789640 1 --2- 172.21.15.143:0/3812870998 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7b006f500 0x7fd7b006f990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00d0cf0 tx=0x7fd7a8010510 comp rx=0 tx=0).stop 2024-05-08T10:23:32.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.235+0000 7fd7b8789640 1 -- 172.21.15.143:0/3812870998 shutdown_connections 2024-05-08T10:23:32.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.235+0000 7fd7b8789640 1 --2- 172.21.15.143:0/3812870998 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7b006f500 0x7fd7b006f990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.235+0000 7fd7b8789640 1 --2- 172.21.15.143:0/3812870998 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd7b014a4c0 0x7fd7b0152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.235+0000 7fd7b8789640 1 --2- 172.21.15.143:0/3812870998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c003a50 0x7fd7b0149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.235+0000 7fd7b8789640 1 -- 172.21.15.143:0/3812870998 >> 172.21.15.143:0/3812870998 conn(0x7fd7b006c500 msgr2=0x7fd7b015c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:32.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.235+0000 7fd7b8789640 1 -- 172.21.15.143:0/3812870998 shutdown_connections 2024-05-08T10:23:32.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:32.235+0000 7fd7b8789640 1 -- 172.21.15.143:0/3812870998 wait complete. 2024-05-08T10:23:32.231 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T10:23:32.231 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T10:23:32.231 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:32.231 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T10:23:32.250 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:32.265+0000 7f5e28921040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T10:23:32.256 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:32.256 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T10:23:32.269 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:32.284+0000 7f1a177b8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T10:23:32.293 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:32.293 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T10:23:32.359 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:23:32.359 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T10:23:32.416 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:32.431+0000 7f5e28921040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T10:23:32.425 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:32.425 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T10:23:32.436 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:32.452+0000 7f1a177b8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T10:23:32.450 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:32.451 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T10:23:32.473 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:32.487+0000 7f5e28921040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T10:23:32.491 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:32.506+0000 7f1a177b8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T10:23:32.497 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:32.497 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T10:23:32.563 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:23:32.563 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T10:23:32.628 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new b8052b6c-3142-430e-8d27-06812219f3c3 0 2024-05-08T10:23:32.735 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:32.750+0000 7f1a177b8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T10:23:32.745 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:32.760+0000 7f5e28921040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T10:23:32.767 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.782+0000 7f913d1da640 1 Processor -- start 2024-05-08T10:23:32.768 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.782+0000 7f913d1da640 1 -- start start 2024-05-08T10:23:32.770 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.783+0000 7f913d1da640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91380d2270 0x7f91380d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.770 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.783+0000 7f913d1da640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f91380afb90 0x7f91380aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.770 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.783+0000 7f913d1da640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9138070200 con 0x7f9138145b10 2024-05-08T10:23:32.770 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.783+0000 7f913d1da640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f91380d2c20 con 0x7f91380d2270 2024-05-08T10:23:32.770 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.783+0000 7f913d1da640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f9138145ef0 con 0x7f91380afb90 2024-05-08T10:23:32.770 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.783+0000 7f913759e640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f91380afb90 0x7f91380aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.783+0000 7f913759e640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f91380afb90 0x7f91380aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38456/0 (socket says 172.21.15.163:38456) 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.783+0000 7f913759e640 1 -- 172.21.15.163:0/4125178646 learned_addr learned my addr 172.21.15.163:0/4125178646 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.783+0000 7f913659c640 1 --2- 172.21.15.163:0/4125178646 >> v2:172.21.15.143:3300/0 conn(0x7f91380d2270 0x7f91380d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.784+0000 7f9135d9b640 1 -- 172.21.15.163:0/4125178646 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213324685 0 0) 0x7f9138070200 con 0x7f9138145b10 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.784+0000 7f9135d9b640 1 -- 172.21.15.163:0/4125178646 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9120003520 con 0x7f9138145b10 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.784+0000 7f913759e640 1 -- 172.21.15.163:0/4125178646 >> v2:172.21.15.143:3300/0 conn(0x7f91380d2270 msgr2=0x7f91380d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.784+0000 7f913759e640 1 --2- 172.21.15.163:0/4125178646 >> v2:172.21.15.143:3300/0 conn(0x7f91380d2270 0x7f91380d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.784+0000 7f913759e640 1 -- 172.21.15.163:0/4125178646 >> v1:172.21.15.143:6789/0 conn(0x7f9138145b10 legacy=0x7f91380b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.784+0000 7f913759e640 1 -- 172.21.15.163:0/4125178646 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91380704e0 con 0x7f91380afb90 2024-05-08T10:23:32.771 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.784+0000 7f913759e640 1 --2- 172.21.15.163:0/4125178646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380afb90 0x7f91380aff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f91380ce150 tx=0x7f913002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27cce2f5d95de796 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:32.772 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f9135d9b640 1 -- 172.21.15.163:0/4125178646 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130036070 con 0x7f91380afb90 2024-05-08T10:23:32.772 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f9135d9b640 1 -- 172.21.15.163:0/4125178646 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9130031600 con 0x7f91380afb90 2024-05-08T10:23:32.772 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f9135d9b640 1 -- 172.21.15.163:0/4125178646 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91300319d0 con 0x7f91380afb90 2024-05-08T10:23:32.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f913d1da640 1 -- 172.21.15.163:0/4125178646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380afb90 msgr2=0x7f91380aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f913d1da640 1 --2- 172.21.15.163:0/4125178646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380afb90 0x7f91380aff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f91380ce150 tx=0x7f913002a730 comp rx=0 tx=0).stop 2024-05-08T10:23:32.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f913d1da640 1 -- 172.21.15.163:0/4125178646 shutdown_connections 2024-05-08T10:23:32.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f913d1da640 1 --2- 172.21.15.163:0/4125178646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380afb90 0x7f91380aff90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f913d1da640 1 --2- 172.21.15.163:0/4125178646 >> v2:172.21.15.143:3300/0 conn(0x7f91380d2270 0x7f91380d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f913d1da640 1 -- 172.21.15.163:0/4125178646 >> 172.21.15.163:0/4125178646 conn(0x7f913806d610 msgr2=0x7f913806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:32.773 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f913d1da640 1 -- 172.21.15.163:0/4125178646 shutdown_connections 2024-05-08T10:23:32.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.785+0000 7f913d1da640 1 -- 172.21.15.163:0/4125178646 wait complete. 2024-05-08T10:23:32.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.787+0000 7f913d1da640 1 Processor -- start 2024-05-08T10:23:32.774 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.787+0000 7f913d1da640 1 -- start start 2024-05-08T10:23:32.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913d1da640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91380afb90 0x7f913815bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913d1da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91380d2270 0x7f913809ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913d1da640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9138145b10 0x7f91380b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913d1da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9138070aa0 con 0x7f91380d2270 2024-05-08T10:23:32.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913d1da640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f91380710f0 con 0x7f9138145b10 2024-05-08T10:23:32.777 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913d1da640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9138070d80 con 0x7f91380afb90 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f9136d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91380afb90 0x7f913815bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913759e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9138145b10 0x7f91380b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913759e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9138145b10 0x7f91380b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38468/0 (socket says 172.21.15.163:38468) 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913759e640 1 -- 172.21.15.163:0/4081248929 learned_addr learned my addr 172.21.15.163:0/4081248929 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f9136d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91380afb90 0x7f913815bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:45192/0 (socket says 172.21.15.163:45192) 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913659c640 1 --2- 172.21.15.163:0/4081248929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91380d2270 0x7f913809ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f9136d9d640 1 -- 172.21.15.163:0/4081248929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9138145b10 msgr2=0x7f91380b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f9136d9d640 1 --2- 172.21.15.163:0/4081248929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9138145b10 0x7f91380b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f9136d9d640 1 -- 172.21.15.163:0/4081248929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91380d2270 msgr2=0x7f913809ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.778 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f9136d9d640 1 --2- 172.21.15.163:0/4081248929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91380d2270 0x7f913809ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f9136d9d640 1 -- 172.21.15.163:0/4081248929 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913809d4b0 con 0x7f91380afb90 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f913759e640 1 --2- 172.21.15.163:0/4081248929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9138145b10 0x7f91380b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f9136d9d640 1 --2- 172.21.15.163:0/4081248929 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91380afb90 0x7f913815bc70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f912800c3c0 tx=0x7f912800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f911f7fe640 1 -- 172.21.15.163:0/4081248929 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128017070 con 0x7f91380afb90 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.789+0000 7f911f7fe640 1 -- 172.21.15.163:0/4081248929 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91280052f0 con 0x7f91380afb90 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.790+0000 7f911f7fe640 1 -- 172.21.15.163:0/4081248929 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128003830 con 0x7f91380afb90 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.790+0000 7f913d1da640 1 -- 172.21.15.163:0/4081248929 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913809d790 con 0x7f91380afb90 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.790+0000 7f913d1da640 1 -- 172.21.15.163:0/4081248929 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9138140db0 con 0x7f91380afb90 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.790+0000 7f911f7fe640 1 -- 172.21.15.163:0/4081248929 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f912801a070 con 0x7f91380afb90 2024-05-08T10:23:32.779 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.790+0000 7f911f7fe640 1 -- 172.21.15.163:0/4081248929 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f912801c440 con 0x7f91380afb90 2024-05-08T10:23:32.780 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.791+0000 7f913d1da640 1 -- 172.21.15.163:0/4081248929 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f913806a550 con 0x7f91380afb90 2024-05-08T10:23:32.780 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.793+0000 7f911f7fe640 1 -- 172.21.15.163:0/4081248929 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9128021080 con 0x7f91380afb90 2024-05-08T10:23:32.782 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:32.797+0000 7f1a177b8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T10:23:32.795 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:32.810+0000 7f5e28921040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T10:23:32.849 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.864+0000 7f913d1da640 1 -- 172.21.15.163:0/4081248929 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b8052b6c-3142-430e-8d27-06812219f3c3", "id": 0} v 0) -- 0x7f91380d15d0 con 0x7f91380afb90 2024-05-08T10:23:32.852 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.867+0000 7f911f7fe640 1 -- 172.21.15.163:0/4081248929 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8052b6c-3142-430e-8d27-06812219f3c3", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f9128011590 con 0x7f91380afb90 2024-05-08T10:23:32.852 INFO:teuthology.orchestra.run.smithi163.stdout:0 2024-05-08T10:23:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.868+0000 7f913d1da640 1 -- 172.21.15.163:0/4081248929 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91380afb90 msgr2=0x7f913815bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.868+0000 7f913d1da640 1 --2- 172.21.15.163:0/4081248929 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91380afb90 0x7f913815bc70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f912800c3c0 tx=0x7f912800c880 comp rx=0 tx=0).stop 2024-05-08T10:23:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.868+0000 7f913d1da640 1 -- 172.21.15.163:0/4081248929 shutdown_connections 2024-05-08T10:23:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.868+0000 7f913d1da640 1 --2- 172.21.15.163:0/4081248929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9138145b10 0x7f91380b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.868+0000 7f913d1da640 1 --2- 172.21.15.163:0/4081248929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91380d2270 0x7f913809ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.868+0000 7f913d1da640 1 --2- 172.21.15.163:0/4081248929 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91380afb90 0x7f913815bc70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.868+0000 7f913d1da640 1 -- 172.21.15.163:0/4081248929 >> 172.21.15.163:0/4081248929 conn(0x7f913806d610 msgr2=0x7f913815d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.868+0000 7f913d1da640 1 -- 172.21.15.163:0/4081248929 shutdown_connections 2024-05-08T10:23:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.868+0000 7f913d1da640 1 -- 172.21.15.163:0/4081248929 wait complete. 2024-05-08T10:23:32.864 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new ceaa1aba-2365-471d-b793-c9f2f75a9c2f 1 2024-05-08T10:23:32.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.978+0000 7fa474746640 1 Processor -- start 2024-05-08T10:23:32.963 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.978+0000 7fa474746640 1 -- start start 2024-05-08T10:23:32.965 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa474746640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa46c1563d0 0x7fa46c160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.965 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa474746640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c0b0db0 0x7fa46c073d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa474746640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46c0b12b0 con 0x7fa46c0d2180 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa474746640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa46c15fe70 con 0x7fa46c1563d0 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa474746640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c0b1590 con 0x7fa46c0b0db0 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa4724e2640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa46c1563d0 0x7fa46c160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa471ce1640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c0b0db0 0x7fa46c073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa4724e2640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa46c1563d0 0x7fa46c160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38472/0 (socket says 172.21.15.163:38472) 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa4724e2640 1 -- 172.21.15.163:0/1262862450 learned_addr learned my addr 172.21.15.163:0/1262862450 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa4724e2640 1 -- 172.21.15.163:0/1262862450 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c0b0db0 msgr2=0x7fa46c073d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa4724e2640 1 --2- 172.21.15.163:0/1262862450 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c0b0db0 0x7fa46c073d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa4724e2640 1 -- 172.21.15.163:0/1262862450 >> v1:172.21.15.143:6789/0 conn(0x7fa46c0d2180 legacy=0x7fa46c162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.966 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.979+0000 7fa4724e2640 1 -- 172.21.15.163:0/1262862450 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c15fb00 con 0x7fa46c1563d0 2024-05-08T10:23:32.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.980+0000 7fa4724e2640 1 --2- 172.21.15.163:0/1262862450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c1563d0 0x7fa46c160300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa460009870 tx=0x7fa46002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19be2883bfb39e37 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:32.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.980+0000 7fa4714e0640 1 -- 172.21.15.163:0/1262862450 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa460037070 con 0x7fa46c1563d0 2024-05-08T10:23:32.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.980+0000 7fa4714e0640 1 -- 172.21.15.163:0/1262862450 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa460032440 con 0x7fa46c1563d0 2024-05-08T10:23:32.967 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.980+0000 7fa4714e0640 1 -- 172.21.15.163:0/1262862450 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa460032810 con 0x7fa46c1563d0 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.981+0000 7fa474746640 1 -- 172.21.15.163:0/1262862450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c1563d0 msgr2=0x7fa46c160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.981+0000 7fa474746640 1 --2- 172.21.15.163:0/1262862450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c1563d0 0x7fa46c160300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa460009870 tx=0x7fa46002a270 comp rx=0 tx=0).stop 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.981+0000 7fa474746640 1 -- 172.21.15.163:0/1262862450 shutdown_connections 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.981+0000 7fa474746640 1 --2- 172.21.15.163:0/1262862450 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c0b0db0 0x7fa46c073d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.981+0000 7fa474746640 1 --2- 172.21.15.163:0/1262862450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c1563d0 0x7fa46c160300 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.981+0000 7fa474746640 1 -- 172.21.15.163:0/1262862450 >> 172.21.15.163:0/1262862450 conn(0x7fa46c06d610 msgr2=0x7fa46c06da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.981+0000 7fa474746640 1 -- 172.21.15.163:0/1262862450 shutdown_connections 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.981+0000 7fa474746640 1 -- 172.21.15.163:0/1262862450 wait complete. 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.982+0000 7fa474746640 1 Processor -- start 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.982+0000 7fa474746640 1 -- start start 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa474746640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa46c0b0db0 0x7fa46c157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.971 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa474746640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c0d2180 0x7fa46c145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa474746640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c1563d0 0x7fa46c158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:32.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa474746640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c074280 con 0x7fa46c0b0db0 2024-05-08T10:23:32.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa474746640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c160840 con 0x7fa46c0d2180 2024-05-08T10:23:32.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa474746640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c1567b0 con 0x7fa46c1563d0 2024-05-08T10:23:32.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa471ce1640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c0d2180 0x7fa46c145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa471ce1640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c0d2180 0x7fa46c145530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38484/0 (socket says 172.21.15.163:38484) 2024-05-08T10:23:32.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa471ce1640 1 -- 172.21.15.163:0/281367152 learned_addr learned my addr 172.21.15.163:0/281367152 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:32.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa472ce3640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c1563d0 0x7fa46c158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa4724e2640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa46c0b0db0 0x7fa46c157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa472ce3640 1 -- 172.21.15.163:0/281367152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c0d2180 msgr2=0x7fa46c145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa472ce3640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c0d2180 0x7fa46c145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa472ce3640 1 -- 172.21.15.163:0/281367152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa46c0b0db0 msgr2=0x7fa46c157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa472ce3640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa46c0b0db0 0x7fa46c157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa472ce3640 1 -- 172.21.15.163:0/281367152 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c158bd0 con 0x7fa46c1563d0 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa471ce1640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c0d2180 0x7fa46c145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.983+0000 7fa472ce3640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c1563d0 0x7fa46c158690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c760 tx=0x7fa46400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.984+0000 7fa45effd640 1 -- 172.21.15.163:0/281367152 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464003b70 con 0x7fa46c1563d0 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.984+0000 7fa45effd640 1 -- 172.21.15.163:0/281367152 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa464003d10 con 0x7fa46c1563d0 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.984+0000 7fa45effd640 1 -- 172.21.15.163:0/281367152 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46400aa70 con 0x7fa46c1563d0 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.984+0000 7fa474746640 1 -- 172.21.15.163:0/281367152 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c158e70 con 0x7fa46c1563d0 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.984+0000 7fa474746640 1 -- 172.21.15.163:0/281367152 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c159430 con 0x7fa46c1563d0 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.984+0000 7fa45effd640 1 -- 172.21.15.163:0/281367152 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa46400ac10 con 0x7fa46c1563d0 2024-05-08T10:23:32.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.984+0000 7fa45effd640 1 -- 172.21.15.163:0/281367152 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fa464012540 con 0x7fa46c1563d0 2024-05-08T10:23:32.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.985+0000 7fa474746640 1 -- 172.21.15.163:0/281367152 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c06a550 con 0x7fa46c1563d0 2024-05-08T10:23:32.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:32.987+0000 7fa45effd640 1 -- 172.21.15.163:0/281367152 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa4640050d0 con 0x7fa46c1563d0 2024-05-08T10:23:33.042 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.057+0000 7fa474746640 1 -- 172.21.15.163:0/281367152 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ceaa1aba-2365-471d-b793-c9f2f75a9c2f", "id": 1} v 0) -- 0x7fa46c153250 con 0x7fa46c1563d0 2024-05-08T10:23:33.046 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.061+0000 7fa45effd640 1 -- 172.21.15.163:0/281367152 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ceaa1aba-2365-471d-b793-c9f2f75a9c2f", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fa4640052b0 con 0x7fa46c1563d0 2024-05-08T10:23:33.047 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-05-08T10:23:33.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.062+0000 7fa474746640 1 -- 172.21.15.163:0/281367152 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c1563d0 msgr2=0x7fa46c158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.062+0000 7fa474746640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c1563d0 0x7fa46c158690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c760 tx=0x7fa46400cc20 comp rx=0 tx=0).stop 2024-05-08T10:23:33.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.062+0000 7fa474746640 1 -- 172.21.15.163:0/281367152 shutdown_connections 2024-05-08T10:23:33.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.062+0000 7fa474746640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa46c1563d0 0x7fa46c158690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.062+0000 7fa474746640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa46c0d2180 0x7fa46c145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.062+0000 7fa474746640 1 --2- 172.21.15.163:0/281367152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa46c0b0db0 0x7fa46c157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.062+0000 7fa474746640 1 -- 172.21.15.163:0/281367152 >> 172.21.15.163:0/281367152 conn(0x7fa46c06d610 msgr2=0x7fa46c162400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.062+0000 7fa474746640 1 -- 172.21.15.163:0/281367152 shutdown_connections 2024-05-08T10:23:33.048 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.062+0000 7fa474746640 1 -- 172.21.15.163:0/281367152 wait complete. 2024-05-08T10:23:33.058 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new b2f8c715-7480-433e-bfbb-96753e0b6470 2 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.174+0000 7f8658a99640 1 Processor -- start 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.174+0000 7f8658a99640 1 -- start start 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.175+0000 7f8658a99640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f86540d2270 0x7f86540d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.175+0000 7f8658a99640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8654070200 con 0x7f8654145b10 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.175+0000 7f8658a99640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86540704e0 con 0x7f86540afb90 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.175+0000 7f8658a99640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f86540d2c20 con 0x7f86540d2270 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.175+0000 7f8651d9b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f86540d2270 0x7f86540d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.176+0000 7f8652d9d640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f86540afb90 0x7f86540aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50218/0 (socket says 172.21.15.163:50218) 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.176+0000 7f8652d9d640 1 -- 172.21.15.163:0/155823001 learned_addr learned my addr 172.21.15.163:0/155823001 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-05-08T10:23:33.164 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.176+0000 7f8651d9b640 1 -- 172.21.15.163:0/155823001 >> v1:172.21.15.163:6789/0 conn(0x7f86540afb90 legacy=0x7f86540aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.176+0000 7f8651d9b640 1 -- 172.21.15.163:0/155823001 >> v1:172.21.15.143:6789/0 conn(0x7f8654145b10 legacy=0x7f86540b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.176+0000 7f8651d9b640 1 -- 172.21.15.163:0/155823001 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86540707c0 con 0x7f86540d2270 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.176+0000 7f8651d9b640 1 --2- 172.21.15.163:0/155823001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540d2270 0x7f86540d26e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f863c0097a0 tx=0x7f863c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea9fdb3a1f67cf91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.177+0000 7f865159a640 1 -- 172.21.15.163:0/155823001 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c037070 con 0x7f86540d2270 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.177+0000 7f865159a640 1 -- 172.21.15.163:0/155823001 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c032440 con 0x7f86540d2270 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.177+0000 7f865159a640 1 -- 172.21.15.163:0/155823001 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c032810 con 0x7f86540d2270 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.177+0000 7f8658a99640 1 -- 172.21.15.163:0/155823001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540d2270 msgr2=0x7f86540d26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.177+0000 7f8658a99640 1 --2- 172.21.15.163:0/155823001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540d2270 0x7f86540d26e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f863c0097a0 tx=0x7f863c02a230 comp rx=0 tx=0).stop 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.178+0000 7f8658a99640 1 -- 172.21.15.163:0/155823001 shutdown_connections 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.178+0000 7f8658a99640 1 --2- 172.21.15.163:0/155823001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540d2270 0x7f86540d26e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.178+0000 7f8658a99640 1 -- 172.21.15.163:0/155823001 >> 172.21.15.163:0/155823001 conn(0x7f865406d610 msgr2=0x7f865406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.178+0000 7f8658a99640 1 -- 172.21.15.163:0/155823001 shutdown_connections 2024-05-08T10:23:33.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.178+0000 7f8658a99640 1 -- 172.21.15.163:0/155823001 wait complete. 2024-05-08T10:23:33.168 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.180+0000 7f8658a99640 1 Processor -- start 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.180+0000 7f8658a99640 1 -- start start 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8658a99640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540afb90 0x7f865415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8658a99640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540d2270 0x7f86541f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8658a99640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8654145b10 0x7f86541f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8658a99640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f86540710f0 con 0x7f8654145b10 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8658a99640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8654145ef0 con 0x7f86540afb90 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8658a99640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8654070d80 con 0x7f86540d2270 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8651d9b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540d2270 0x7f86541f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f865259c640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540afb90 0x7f865415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8651d9b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540d2270 0x7f86541f63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:45214/0 (socket says 172.21.15.163:45214) 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8651d9b640 1 -- 172.21.15.163:0/783383441 learned_addr learned my addr 172.21.15.163:0/783383441 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f865259c640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540afb90 0x7f865415bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38506/0 (socket says 172.21.15.163:38506) 2024-05-08T10:23:33.169 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8652d9d640 1 --2- 172.21.15.163:0/783383441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8654145b10 0x7f86541f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f865259c640 1 -- 172.21.15.163:0/783383441 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540d2270 msgr2=0x7f86541f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f865259c640 1 --2- 172.21.15.163:0/783383441 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540d2270 0x7f86541f63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f865259c640 1 -- 172.21.15.163:0/783383441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8654145b10 msgr2=0x7f86541f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f865259c640 1 --2- 172.21.15.163:0/783383441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8654145b10 0x7f86541f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f865259c640 1 -- 172.21.15.163:0/783383441 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865409caa0 con 0x7f86540afb90 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.181+0000 7f8651d9b640 1 --2- 172.21.15.163:0/783383441 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540d2270 0x7f86541f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.182+0000 7f865259c640 1 --2- 172.21.15.163:0/783383441 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540afb90 0x7f865415bd00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f864400c3f0 tx=0x7f864400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.182+0000 7f864affd640 1 -- 172.21.15.163:0/783383441 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644017070 con 0x7f86540afb90 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.182+0000 7f864affd640 1 -- 172.21.15.163:0/783383441 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86440052d0 con 0x7f86540afb90 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.182+0000 7f8658a99640 1 -- 172.21.15.163:0/783383441 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865409cd80 con 0x7f86540afb90 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.182+0000 7f864affd640 1 -- 172.21.15.163:0/783383441 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644003830 con 0x7f86540afb90 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.182+0000 7f8658a99640 1 -- 172.21.15.163:0/783383441 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865409d340 con 0x7f86540afb90 2024-05-08T10:23:33.170 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.182+0000 7f864affd640 1 -- 172.21.15.163:0/783383441 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f864401a070 con 0x7f86540afb90 2024-05-08T10:23:33.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.182+0000 7f864affd640 1 -- 172.21.15.163:0/783383441 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8644012420 con 0x7f86540afb90 2024-05-08T10:23:33.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.183+0000 7f8658a99640 1 -- 172.21.15.163:0/783383441 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865406a550 con 0x7f86540afb90 2024-05-08T10:23:33.171 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.185+0000 7f864affd640 1 -- 172.21.15.163:0/783383441 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8644021070 con 0x7f86540afb90 2024-05-08T10:23:33.243 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.258+0000 7f8658a99640 1 -- 172.21.15.163:0/783383441 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b2f8c715-7480-433e-bfbb-96753e0b6470", "id": 2} v 0) -- 0x7f8654144ee0 con 0x7f86540afb90 2024-05-08T10:23:33.248 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.263+0000 7f864affd640 1 -- 172.21.15.163:0/783383441 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2f8c715-7480-433e-bfbb-96753e0b6470", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f86440115b0 con 0x7f86540afb90 2024-05-08T10:23:33.249 INFO:teuthology.orchestra.run.smithi163.stdout:2 2024-05-08T10:23:33.250 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.264+0000 7f8658a99640 1 -- 172.21.15.163:0/783383441 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540afb90 msgr2=0x7f865415bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.250 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.264+0000 7f8658a99640 1 --2- 172.21.15.163:0/783383441 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540afb90 0x7f865415bd00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f864400c3f0 tx=0x7f864400c8b0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.250 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.264+0000 7f8658a99640 1 -- 172.21.15.163:0/783383441 shutdown_connections 2024-05-08T10:23:33.250 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.264+0000 7f8658a99640 1 --2- 172.21.15.163:0/783383441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8654145b10 0x7f86541f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.264+0000 7f8658a99640 1 --2- 172.21.15.163:0/783383441 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86540d2270 0x7f86541f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.264+0000 7f8658a99640 1 --2- 172.21.15.163:0/783383441 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86540afb90 0x7f865415bd00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.264+0000 7f8658a99640 1 -- 172.21.15.163:0/783383441 >> 172.21.15.163:0/783383441 conn(0x7f865406d610 msgr2=0x7f865406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.264+0000 7f8658a99640 1 -- 172.21.15.163:0/783383441 shutdown_connections 2024-05-08T10:23:33.251 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.264+0000 7f8658a99640 1 -- 172.21.15.163:0/783383441 wait complete. 2024-05-08T10:23:33.260 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 93369408-21e3-4ec5-9166-0f775990cf78 3 2024-05-08T10:23:33.359 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.374+0000 7f6cef659640 1 Processor -- start 2024-05-08T10:23:33.360 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.374+0000 7f6cef659640 1 -- start start 2024-05-08T10:23:33.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6cef659640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6ce815f4c0 0x7f6ce8163020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6cef659640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6ce80d0720 0x7f6ce80d3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6cef659640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce8163560 con 0x7f6ce80bab60 2024-05-08T10:23:33.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6cef659640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce81637e0 con 0x7f6ce815f4c0 2024-05-08T10:23:33.361 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6cef659640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce8163ac0 con 0x7f6ce80d0720 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6cedbf6640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6ce80d0720 0x7f6ce80d3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6cedbf6640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6ce80d0720 0x7f6ce80d3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38520/0 (socket says 172.21.15.163:38520) 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6cedbf6640 1 -- 172.21.15.163:0/258660137 learned_addr learned my addr 172.21.15.163:0/258660137 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6cecbf4640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f6ce80bab60 0x7f6ce80d0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50222/0 (socket says 172.21.15.163:50222) 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.375+0000 7f6ced3f5640 1 --2- 172.21.15.163:0/258660137 >> v2:172.21.15.143:3300/0 conn(0x7f6ce815f4c0 0x7f6ce8163020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.376+0000 7f6cedbf6640 1 -- 172.21.15.163:0/258660137 >> v2:172.21.15.143:3300/0 conn(0x7f6ce815f4c0 msgr2=0x7f6ce8163020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.376+0000 7f6cedbf6640 1 --2- 172.21.15.163:0/258660137 >> v2:172.21.15.143:3300/0 conn(0x7f6ce815f4c0 0x7f6ce8163020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.376+0000 7f6cedbf6640 1 -- 172.21.15.163:0/258660137 >> v1:172.21.15.163:6789/0 conn(0x7f6ce80bab60 legacy=0x7f6ce80d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.376+0000 7f6cedbf6640 1 -- 172.21.15.163:0/258660137 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce8163da0 con 0x7f6ce80d0720 2024-05-08T10:23:33.362 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.376+0000 7f6ced3f5640 1 --2- 172.21.15.163:0/258660137 >> v2:172.21.15.143:3300/0 conn(0x7f6ce815f4c0 0x7f6ce8163020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:33.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.377+0000 7f6cedbf6640 1 --2- 172.21.15.163:0/258660137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 0x7f6ce80d3cd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ce806e360 tx=0x7f6ce002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=301e3127dbe26238 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.377+0000 7f6cdffff640 1 -- 172.21.15.163:0/258660137 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0036070 con 0x7f6ce80d0720 2024-05-08T10:23:33.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.377+0000 7f6cdffff640 1 -- 172.21.15.163:0/258660137 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce0031600 con 0x7f6ce80d0720 2024-05-08T10:23:33.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.377+0000 7f6cdffff640 1 -- 172.21.15.163:0/258660137 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00319d0 con 0x7f6ce80d0720 2024-05-08T10:23:33.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.377+0000 7f6cef659640 1 -- 172.21.15.163:0/258660137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 msgr2=0x7f6ce80d3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.377+0000 7f6cef659640 1 --2- 172.21.15.163:0/258660137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 0x7f6ce80d3cd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ce806e360 tx=0x7f6ce002a730 comp rx=0 tx=0).stop 2024-05-08T10:23:33.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.378+0000 7f6cef659640 1 -- 172.21.15.163:0/258660137 shutdown_connections 2024-05-08T10:23:33.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.378+0000 7f6cef659640 1 --2- 172.21.15.163:0/258660137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 0x7f6ce80d3cd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.364 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.378+0000 7f6cef659640 1 --2- 172.21.15.163:0/258660137 >> v2:172.21.15.143:3300/0 conn(0x7f6ce815f4c0 0x7f6ce8163020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.378+0000 7f6cef659640 1 -- 172.21.15.163:0/258660137 >> 172.21.15.163:0/258660137 conn(0x7f6ce806d300 msgr2=0x7f6ce806d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.378+0000 7f6cef659640 1 -- 172.21.15.163:0/258660137 shutdown_connections 2024-05-08T10:23:33.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.378+0000 7f6cef659640 1 -- 172.21.15.163:0/258660137 wait complete. 2024-05-08T10:23:33.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.379+0000 7f6cef659640 1 Processor -- start 2024-05-08T10:23:33.365 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.379+0000 7f6cef659640 1 -- start start 2024-05-08T10:23:33.367 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.379+0000 7f6cef659640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ce80bab60 0x7f6ce814cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.367 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cef659640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 0x7f6ce8162370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.367 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cef659640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ce815f4c0 0x7f6ce80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.367 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cef659640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce80d4210 con 0x7f6ce80bab60 2024-05-08T10:23:33.367 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cef659640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce815f8a0 con 0x7f6ce80d0720 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cef659640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce80d4390 con 0x7f6ce815f4c0 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cecbf4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 0x7f6ce8162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cecbf4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 0x7f6ce8162370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38526/0 (socket says 172.21.15.163:38526) 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cecbf4640 1 -- 172.21.15.163:0/3389635277 learned_addr learned my addr 172.21.15.163:0/3389635277 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cedbf6640 1 --2- 172.21.15.163:0/3389635277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ce815f4c0 0x7f6ce80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6ced3f5640 1 --2- 172.21.15.163:0/3389635277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ce80bab60 0x7f6ce814cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cecbf4640 1 -- 172.21.15.163:0/3389635277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ce815f4c0 msgr2=0x7f6ce80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cecbf4640 1 --2- 172.21.15.163:0/3389635277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ce815f4c0 0x7f6ce80c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cecbf4640 1 -- 172.21.15.163:0/3389635277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ce80bab60 msgr2=0x7f6ce814cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cecbf4640 1 --2- 172.21.15.163:0/3389635277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ce80bab60 0x7f6ce814cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cecbf4640 1 -- 172.21.15.163:0/3389635277 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce81628b0 con 0x7f6ce80d0720 2024-05-08T10:23:33.368 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cecbf4640 1 --2- 172.21.15.163:0/3389635277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 0x7f6ce8162370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c4d0 tx=0x7f6ce400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cddffb640 1 -- 172.21.15.163:0/3389635277 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4018070 con 0x7f6ce80d0720 2024-05-08T10:23:33.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cddffb640 1 -- 172.21.15.163:0/3389635277 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce4007480 con 0x7f6ce80d0720 2024-05-08T10:23:33.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cef659640 1 -- 172.21.15.163:0/3389635277 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce80b5ab0 con 0x7f6ce80d0720 2024-05-08T10:23:33.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.380+0000 7f6cddffb640 1 -- 172.21.15.163:0/3389635277 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40049e0 con 0x7f6ce80d0720 2024-05-08T10:23:33.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.381+0000 7f6cef659640 1 -- 172.21.15.163:0/3389635277 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce80b6070 con 0x7f6ce80d0720 2024-05-08T10:23:33.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.381+0000 7f6cddffb640 1 -- 172.21.15.163:0/3389635277 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ce401b070 con 0x7f6ce80d0720 2024-05-08T10:23:33.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.381+0000 7f6cddffb640 1 -- 172.21.15.163:0/3389635277 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6ce401ccc0 con 0x7f6ce80d0720 2024-05-08T10:23:33.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.381+0000 7f6cef659640 1 -- 172.21.15.163:0/3389635277 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce806a550 con 0x7f6ce80d0720 2024-05-08T10:23:33.369 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.383+0000 7f6cddffb640 1 -- 172.21.15.163:0/3389635277 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6ce4033ec0 con 0x7f6ce80d0720 2024-05-08T10:23:33.440 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.454+0000 7f6cef659640 1 -- 172.21.15.163:0/3389635277 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93369408-21e3-4ec5-9166-0f775990cf78", "id": 3} v 0) -- 0x7f6ce80b3ee0 con 0x7f6ce80d0720 2024-05-08T10:23:33.445 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.460+0000 7f6cddffb640 1 -- 172.21.15.163:0/3389635277 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93369408-21e3-4ec5-9166-0f775990cf78", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6ce4022070 con 0x7f6ce80d0720 2024-05-08T10:23:33.445 INFO:teuthology.orchestra.run.smithi163.stdout:3 2024-05-08T10:23:33.446 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.461+0000 7f6cef659640 1 -- 172.21.15.163:0/3389635277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 msgr2=0x7f6ce8162370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.446 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.461+0000 7f6cef659640 1 --2- 172.21.15.163:0/3389635277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 0x7f6ce8162370 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c4d0 tx=0x7f6ce400c990 comp rx=0 tx=0).stop 2024-05-08T10:23:33.446 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.461+0000 7f6cef659640 1 -- 172.21.15.163:0/3389635277 shutdown_connections 2024-05-08T10:23:33.447 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.461+0000 7f6cef659640 1 --2- 172.21.15.163:0/3389635277 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ce815f4c0 0x7f6ce80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.447 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.461+0000 7f6cef659640 1 --2- 172.21.15.163:0/3389635277 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce80d0720 0x7f6ce8162370 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.447 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.461+0000 7f6cef659640 1 --2- 172.21.15.163:0/3389635277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ce80bab60 0x7f6ce814cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.447 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.461+0000 7f6cef659640 1 -- 172.21.15.163:0/3389635277 >> 172.21.15.163:0/3389635277 conn(0x7f6ce806d300 msgr2=0x7f6ce806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.447 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.461+0000 7f6cef659640 1 -- 172.21.15.163:0/3389635277 shutdown_connections 2024-05-08T10:23:33.447 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.461+0000 7f6cef659640 1 -- 172.21.15.163:0/3389635277 wait complete. 2024-05-08T10:23:33.457 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 7e555f1e-80d2-4b01-a986-b86f40c1cfc4 4 2024-05-08T10:23:33.548 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:33.563+0000 7f1a177b8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T10:23:33.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.570+0000 7fa3d9c93640 1 Processor -- start 2024-05-08T10:23:33.556 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.570+0000 7fa3d9c93640 1 -- start start 2024-05-08T10:23:33.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.571+0000 7fa3d9c93640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa3d40b0db0 0x7fa3d4073d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.571+0000 7fa3d9c93640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d40b12b0 con 0x7fa3d40d2180 2024-05-08T10:23:33.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.571+0000 7fa3d9c93640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d40b1590 con 0x7fa3d41563d0 2024-05-08T10:23:33.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.571+0000 7fa3d9c93640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d415fe70 con 0x7fa3d40b0db0 2024-05-08T10:23:33.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.571+0000 7fa3d2ffd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa3d40b0db0 0x7fa3d4073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.571+0000 7fa3d37fe640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fa3d41563d0 0x7fa3d4160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50224/0 (socket says 172.21.15.163:50224) 2024-05-08T10:23:33.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.571+0000 7fa3d2ffd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa3d40b0db0 0x7fa3d4073d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38528/0 (socket says 172.21.15.163:38528) 2024-05-08T10:23:33.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.571+0000 7fa3d37fe640 1 -- 172.21.15.163:0/4216747588 learned_addr learned my addr 172.21.15.163:0/4216747588 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-05-08T10:23:33.559 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.572+0000 7fa3d2ffd640 1 -- 172.21.15.163:0/4216747588 >> v1:172.21.15.163:6789/0 conn(0x7fa3d41563d0 legacy=0x7fa3d4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.572+0000 7fa3d2ffd640 1 -- 172.21.15.163:0/4216747588 >> v1:172.21.15.143:6789/0 conn(0x7fa3d40d2180 legacy=0x7fa3d4162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.572+0000 7fa3d27fc640 1 -- 172.21.15.163:0/4216747588 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 650482321 0 0) 0x7fa3d40b1590 con 0x7fa3d41563d0 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.572+0000 7fa3d2ffd640 1 -- 172.21.15.163:0/4216747588 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d415fb00 con 0x7fa3d40b0db0 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.572+0000 7fa3d2ffd640 1 --2- 172.21.15.163:0/4216747588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 0x7fa3d4073d40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0097d0 tx=0x7fa3bc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9220a841f38cca83 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d27fc640 1 -- 172.21.15.163:0/4216747588 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc037070 con 0x7fa3d40b0db0 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d27fc640 1 -- 172.21.15.163:0/4216747588 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3bc032440 con 0x7fa3d40b0db0 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d27fc640 1 -- 172.21.15.163:0/4216747588 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc032810 con 0x7fa3d40b0db0 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d9c93640 1 -- 172.21.15.163:0/4216747588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 msgr2=0x7fa3d4073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d9c93640 1 --2- 172.21.15.163:0/4216747588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 0x7fa3d4073d40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0097d0 tx=0x7fa3bc02a270 comp rx=0 tx=0).stop 2024-05-08T10:23:33.560 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d9c93640 1 -- 172.21.15.163:0/4216747588 shutdown_connections 2024-05-08T10:23:33.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d9c93640 1 --2- 172.21.15.163:0/4216747588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 0x7fa3d4073d40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d9c93640 1 -- 172.21.15.163:0/4216747588 >> 172.21.15.163:0/4216747588 conn(0x7fa3d406d610 msgr2=0x7fa3d406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d9c93640 1 -- 172.21.15.163:0/4216747588 shutdown_connections 2024-05-08T10:23:33.561 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.573+0000 7fa3d9c93640 1 -- 172.21.15.163:0/4216747588 wait complete. 2024-05-08T10:23:33.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.574+0000 7fa3d9c93640 1 Processor -- start 2024-05-08T10:23:33.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.575+0000 7fa3d9c93640 1 -- start start 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.575+0000 7fa3d9c93640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 0x7fa3d40b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.575+0000 7fa3d9c93640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3d40d2180 0x7fa3d4156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.575+0000 7fa3d9c93640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3d41563d0 0x7fa3d4157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.575+0000 7fa3d9c93640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d41567b0 con 0x7fa3d41563d0 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.575+0000 7fa3d9c93640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d4074280 con 0x7fa3d40b0db0 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.575+0000 7fa3d9c93640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d4156930 con 0x7fa3d40d2180 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d37fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 0x7fa3d40b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d2ffd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3d40d2180 0x7fa3d4156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d37fe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 0x7fa3d40b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38536/0 (socket says 172.21.15.163:38536) 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d37fe640 1 -- 172.21.15.163:0/3915824638 learned_addr learned my addr 172.21.15.163:0/3915824638 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d3fff640 1 --2- 172.21.15.163:0/3915824638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3d41563d0 0x7fa3d4157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.565 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d2ffd640 1 -- 172.21.15.163:0/3915824638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 msgr2=0x7fa3d40b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d2ffd640 1 --2- 172.21.15.163:0/3915824638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 0x7fa3d40b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d2ffd640 1 -- 172.21.15.163:0/3915824638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3d41563d0 msgr2=0x7fa3d4157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d2ffd640 1 --2- 172.21.15.163:0/3915824638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3d41563d0 0x7fa3d4157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d2ffd640 1 -- 172.21.15.163:0/3915824638 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d4158430 con 0x7fa3d40d2180 2024-05-08T10:23:33.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d37fe640 1 --2- 172.21.15.163:0/3915824638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 0x7fa3d40b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:33.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d2ffd640 1 --2- 172.21.15.163:0/3915824638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3d40d2180 0x7fa3d4156b10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc031000 tx=0x7fa3bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3cbfff640 1 -- 172.21.15.163:0/3915824638 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc032e60 con 0x7fa3d40d2180 2024-05-08T10:23:33.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3cbfff640 1 -- 172.21.15.163:0/3915824638 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3bc0307b0 con 0x7fa3d40d2180 2024-05-08T10:23:33.566 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d9c93640 1 -- 172.21.15.163:0/3915824638 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d41576f0 con 0x7fa3d40d2180 2024-05-08T10:23:33.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3cbfff640 1 -- 172.21.15.163:0/3915824638 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc037040 con 0x7fa3d40d2180 2024-05-08T10:23:33.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3d9c93640 1 -- 172.21.15.163:0/3915824638 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d41586d0 con 0x7fa3d40d2180 2024-05-08T10:23:33.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3cbfff640 1 -- 172.21.15.163:0/3915824638 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa3bc044020 con 0x7fa3d40d2180 2024-05-08T10:23:33.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.576+0000 7fa3cbfff640 1 -- 172.21.15.163:0/3915824638 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa3bc03dd00 con 0x7fa3d40d2180 2024-05-08T10:23:33.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.577+0000 7fa3d9c93640 1 -- 172.21.15.163:0/3915824638 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d406a550 con 0x7fa3d40d2180 2024-05-08T10:23:33.567 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.579+0000 7fa3cbfff640 1 -- 172.21.15.163:0/3915824638 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa3bc03d440 con 0x7fa3d40d2180 2024-05-08T10:23:33.581 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:33.596+0000 7f5e28921040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T10:23:33.635 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.650+0000 7fa3d9c93640 1 -- 172.21.15.163:0/3915824638 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7e555f1e-80d2-4b01-a986-b86f40c1cfc4", "id": 4} v 0) -- 0x7fa3d40d26e0 con 0x7fa3d40d2180 2024-05-08T10:23:33.636 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:33.650+0000 7f1a177b8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T10:23:33.641 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.656+0000 7fa3cbfff640 1 -- 172.21.15.163:0/3915824638 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e555f1e-80d2-4b01-a986-b86f40c1cfc4", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa3bc03d620 con 0x7fa3d40d2180 2024-05-08T10:23:33.642 INFO:teuthology.orchestra.run.smithi163.stdout:4 2024-05-08T10:23:33.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.657+0000 7fa3d9c93640 1 -- 172.21.15.163:0/3915824638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3d40d2180 msgr2=0x7fa3d4156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.657+0000 7fa3d9c93640 1 --2- 172.21.15.163:0/3915824638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3d40d2180 0x7fa3d4156b10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc031000 tx=0x7fa3bc0046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.657+0000 7fa3d9c93640 1 -- 172.21.15.163:0/3915824638 shutdown_connections 2024-05-08T10:23:33.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.657+0000 7fa3d9c93640 1 --2- 172.21.15.163:0/3915824638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3d41563d0 0x7fa3d4157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.657+0000 7fa3d9c93640 1 --2- 172.21.15.163:0/3915824638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3d40d2180 0x7fa3d4156b10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.657+0000 7fa3d9c93640 1 --2- 172.21.15.163:0/3915824638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3d40b0db0 0x7fa3d40b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.657+0000 7fa3d9c93640 1 -- 172.21.15.163:0/3915824638 >> 172.21.15.163:0/3915824638 conn(0x7fa3d406d610 msgr2=0x7fa3d406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.657+0000 7fa3d9c93640 1 -- 172.21.15.163:0/3915824638 shutdown_connections 2024-05-08T10:23:33.643 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.657+0000 7fa3d9c93640 1 -- 172.21.15.163:0/3915824638 wait complete. 2024-05-08T10:23:33.653 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 7c5e74ef-bc54-4ad8-951f-ff503fb0241a 5 2024-05-08T10:23:33.673 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:33.688+0000 7f5e28921040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T10:23:33.678 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:33.693+0000 7f1a177b8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T10:23:33.719 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:33.734+0000 7f5e28921040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T10:23:33.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.767+0000 7f775e275640 1 Processor -- start 2024-05-08T10:23:33.752 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.767+0000 7f775e275640 1 -- start start 2024-05-08T10:23:33.755 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775e275640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 0x7f77580b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.755 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775e275640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f77580b0ba0 0x7f77580d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.755 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775e275640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77580b5e10 con 0x7f77580d2270 2024-05-08T10:23:33.755 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775e275640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f77580d2c10 con 0x7f77580b0ba0 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775e275640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7758145ef0 con 0x7f7758145b10 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775c812640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f77580b0ba0 0x7f77580d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f7757fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 0x7f77580b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f77577fe640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f77580d2270 0x7f7758073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50228/0 (socket says 172.21.15.163:50228) 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f77577fe640 1 -- 172.21.15.163:0/885330298 learned_addr learned my addr 172.21.15.163:0/885330298 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775c812640 1 -- 172.21.15.163:0/885330298 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 msgr2=0x7f77580b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775c812640 1 --2- 172.21.15.163:0/885330298 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 0x7f77580b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775c812640 1 -- 172.21.15.163:0/885330298 >> v1:172.21.15.163:6789/0 conn(0x7f77580d2270 legacy=0x7f7758073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f7756ffd640 1 -- 172.21.15.163:0/885330298 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1592995742 0 0) 0x7f77580b5e10 con 0x7f77580d2270 2024-05-08T10:23:33.756 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.768+0000 7f775c812640 1 -- 172.21.15.163:0/885330298 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7758070200 con 0x7f77580b0ba0 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.769+0000 7f775c812640 1 --2- 172.21.15.163:0/885330298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 0x7f77580d26d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7750009d90 tx=0x7f775002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9628f7d55eac49c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.769+0000 7f7756ffd640 1 -- 172.21.15.163:0/885330298 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750031600 con 0x7f77580b0ba0 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.769+0000 7f7756ffd640 1 -- 172.21.15.163:0/885330298 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77500317a0 con 0x7f77580b0ba0 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.769+0000 7f7756ffd640 1 -- 172.21.15.163:0/885330298 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750031b70 con 0x7f77580b0ba0 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.770+0000 7f775e275640 1 -- 172.21.15.163:0/885330298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 msgr2=0x7f77580d26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.770+0000 7f775e275640 1 --2- 172.21.15.163:0/885330298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 0x7f77580d26d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7750009d90 tx=0x7f775002a5d0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.770+0000 7f775e275640 1 -- 172.21.15.163:0/885330298 shutdown_connections 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.770+0000 7f775e275640 1 --2- 172.21.15.163:0/885330298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 0x7f77580d26d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.770+0000 7f775e275640 1 --2- 172.21.15.163:0/885330298 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 0x7f77580b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.770+0000 7f775e275640 1 -- 172.21.15.163:0/885330298 >> 172.21.15.163:0/885330298 conn(0x7f775806d610 msgr2=0x7f775806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.757 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.770+0000 7f775e275640 1 -- 172.21.15.163:0/885330298 shutdown_connections 2024-05-08T10:23:33.758 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.770+0000 7f775e275640 1 -- 172.21.15.163:0/885330298 wait complete. 2024-05-08T10:23:33.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.771+0000 7f775e275640 1 Processor -- start 2024-05-08T10:23:33.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.771+0000 7f775e275640 1 -- start start 2024-05-08T10:23:33.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775e275640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 0x7f77581f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775e275640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77580d2270 0x7f775809ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775e275640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 0x7f77580cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775e275640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f77580707c0 con 0x7f77580d2270 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775e275640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f77580710f0 con 0x7f77580b0ba0 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775e275640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7758070aa0 con 0x7f7758145b10 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f7757fff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 0x7f77581f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775c812640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 0x7f77580cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f7757fff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 0x7f77581f69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:38556/0 (socket says 172.21.15.163:38556) 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f7757fff640 1 -- 172.21.15.163:0/1102220811 learned_addr learned my addr 172.21.15.163:0/1102220811 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f77577fe640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77580d2270 0x7f775809ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.761 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775c812640 1 -- 172.21.15.163:0/1102220811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 msgr2=0x7f77581f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775c812640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 0x7f77581f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775c812640 1 -- 172.21.15.163:0/1102220811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77580d2270 msgr2=0x7f775809ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775c812640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77580d2270 0x7f775809ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f775c812640 1 -- 172.21.15.163:0/1102220811 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775809f610 con 0x7f7758145b10 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f77577fe640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77580d2270 0x7f775809ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.772+0000 7f7757fff640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 0x7f77581f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.773+0000 7f775c812640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 0x7f77580cd330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7750031000 tx=0x7f7750004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.773+0000 7f7754ff9640 1 -- 172.21.15.163:0/1102220811 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750040070 con 0x7f7758145b10 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.773+0000 7f7754ff9640 1 -- 172.21.15.163:0/1102220811 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7750030ba0 con 0x7f7758145b10 2024-05-08T10:23:33.762 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.773+0000 7f775e275640 1 -- 172.21.15.163:0/1102220811 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775809f8f0 con 0x7f7758145b10 2024-05-08T10:23:33.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.773+0000 7f7754ff9640 1 -- 172.21.15.163:0/1102220811 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750009450 con 0x7f7758145b10 2024-05-08T10:23:33.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.773+0000 7f775e275640 1 -- 172.21.15.163:0/1102220811 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f775809feb0 con 0x7f7758145b10 2024-05-08T10:23:33.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.773+0000 7f7754ff9640 1 -- 172.21.15.163:0/1102220811 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7750039040 con 0x7f7758145b10 2024-05-08T10:23:33.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.773+0000 7f7754ff9640 1 -- 172.21.15.163:0/1102220811 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f7750045c30 con 0x7f7758145b10 2024-05-08T10:23:33.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.774+0000 7f775e275640 1 -- 172.21.15.163:0/1102220811 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775806a550 con 0x7f7758145b10 2024-05-08T10:23:33.763 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.776+0000 7f7754ff9640 1 -- 172.21.15.163:0/1102220811 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7750031700 con 0x7f7758145b10 2024-05-08T10:23:33.832 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.846+0000 7f775e275640 1 -- 172.21.15.163:0/1102220811 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7c5e74ef-bc54-4ad8-951f-ff503fb0241a", "id": 5} v 0) -- 0x7f77580b6a70 con 0x7f7758145b10 2024-05-08T10:23:33.837 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.852+0000 7f7754ff9640 1 -- 172.21.15.163:0/1102220811 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c5e74ef-bc54-4ad8-951f-ff503fb0241a", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f7750045460 con 0x7f7758145b10 2024-05-08T10:23:33.837 INFO:teuthology.orchestra.run.smithi163.stdout:5 2024-05-08T10:23:33.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.852+0000 7f775e275640 1 -- 172.21.15.163:0/1102220811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 msgr2=0x7f77580cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.852+0000 7f775e275640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 0x7f77580cd330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7750031000 tx=0x7f7750004a40 comp rx=0 tx=0).stop 2024-05-08T10:23:33.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.853+0000 7f775e275640 1 -- 172.21.15.163:0/1102220811 shutdown_connections 2024-05-08T10:23:33.838 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.853+0000 7f775e275640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7758145b10 0x7f77580cd330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.853+0000 7f775e275640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f77580d2270 0x7f775809ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.853+0000 7f775e275640 1 --2- 172.21.15.163:0/1102220811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77580b0ba0 0x7f77581f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.853+0000 7f775e275640 1 -- 172.21.15.163:0/1102220811 >> 172.21.15.163:0/1102220811 conn(0x7f775806d610 msgr2=0x7f77580b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.853+0000 7f775e275640 1 -- 172.21.15.163:0/1102220811 shutdown_connections 2024-05-08T10:23:33.839 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:33.853+0000 7f775e275640 1 -- 172.21.15.163:0/1102220811 wait complete. 2024-05-08T10:23:33.844 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:33.859+0000 7f1a177b8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T10:23:33.848 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new c6fdee42-f63f-4b77-ba34-0c148cc4075a 6 2024-05-08T10:23:33.892 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:33.907+0000 7f5e28921040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T10:23:33.899 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:33.914+0000 7f1a177b8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T10:23:33.943 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:33.958+0000 7f5e28921040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T10:23:33.951 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:33.966+0000 7f1a177b8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T10:23:33.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.002+0000 7fccb2ed1640 1 Processor -- start 2024-05-08T10:23:33.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.003+0000 7fccb2ed1640 1 -- start start 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.003+0000 7fccb2ed1640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac145b10 0x7fccac0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.003+0000 7fccb2ed1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccac0b5e10 con 0x7fccac0b0ba0 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.003+0000 7fccb2ed1640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccac074280 con 0x7fccac0d2270 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.003+0000 7fccb2ed1640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fccac145ef0 con 0x7fccac145b10 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.003+0000 7fccb0c6d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac145b10 0x7fccac0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.004+0000 7fccb0c6d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac145b10 0x7fccac0b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:45260/0 (socket says 172.21.15.163:45260) 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.004+0000 7fccb0c6d640 1 -- 172.21.15.163:0/1842976041 learned_addr learned my addr 172.21.15.163:0/1842976041 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.004+0000 7fccabfff640 1 --1- 172.21.15.163:0/1842976041 >> v1:172.21.15.163:6789/0 conn(0x7fccac0d2270 0x7fccac073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50232/0 (socket says 172.21.15.163:50232) 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.004+0000 7fccb0c6d640 1 -- 172.21.15.163:0/1842976041 >> v1:172.21.15.163:6789/0 conn(0x7fccac0d2270 legacy=0x7fccac073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.990 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.004+0000 7fccb0c6d640 1 -- 172.21.15.163:0/1842976041 >> v1:172.21.15.143:6789/0 conn(0x7fccac0b0ba0 legacy=0x7fccac073b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.004+0000 7fccab7fe640 1 -- 172.21.15.163:0/1842976041 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577171316 0 0) 0x7fccac074280 con 0x7fccac0d2270 2024-05-08T10:23:33.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.004+0000 7fccb0c6d640 1 -- 172.21.15.163:0/1842976041 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac070200 con 0x7fccac145b10 2024-05-08T10:23:33.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.004+0000 7fccb0c6d640 1 --2- 172.21.15.163:0/1842976041 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac145b10 0x7fccac0b58d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcca00098a0 tx=0x7fcca002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a983a1b95bd16731 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccab7fe640 1 -- 172.21.15.163:0/1842976041 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0037070 con 0x7fccac145b10 2024-05-08T10:23:33.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccab7fe640 1 -- 172.21.15.163:0/1842976041 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca0032440 con 0x7fccac145b10 2024-05-08T10:23:33.991 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccab7fe640 1 -- 172.21.15.163:0/1842976041 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0032810 con 0x7fccac145b10 2024-05-08T10:23:33.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccb2ed1640 1 -- 172.21.15.163:0/1842976041 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac145b10 msgr2=0x7fccac0b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccb2ed1640 1 --2- 172.21.15.163:0/1842976041 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac145b10 0x7fccac0b58d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcca00098a0 tx=0x7fcca002a250 comp rx=0 tx=0).stop 2024-05-08T10:23:33.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccb2ed1640 1 -- 172.21.15.163:0/1842976041 shutdown_connections 2024-05-08T10:23:33.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccb2ed1640 1 --2- 172.21.15.163:0/1842976041 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac145b10 0x7fccac0b58d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccb2ed1640 1 -- 172.21.15.163:0/1842976041 >> 172.21.15.163:0/1842976041 conn(0x7fccac06d610 msgr2=0x7fccac06da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:33.992 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccb2ed1640 1 -- 172.21.15.163:0/1842976041 shutdown_connections 2024-05-08T10:23:33.993 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.005+0000 7fccb2ed1640 1 -- 172.21.15.163:0/1842976041 wait complete. 2024-05-08T10:23:33.993 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.006+0000 7fccb2ed1640 1 Processor -- start 2024-05-08T10:23:33.993 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.007+0000 7fccb2ed1640 1 -- start start 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.007+0000 7fccb2ed1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0b0ba0 0x7fccac143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.007+0000 7fccb2ed1640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac0d2270 0x7fccac15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.007+0000 7fccb2ed1640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccac145b10 0x7fccac15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.007+0000 7fccb2ed1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fccac0707c0 con 0x7fccac0b0ba0 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.007+0000 7fccb2ed1640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fccac0710f0 con 0x7fccac145b10 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.007+0000 7fccb2ed1640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fccac070aa0 con 0x7fccac0d2270 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccabfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac0d2270 0x7fccac15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb0c6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0b0ba0 0x7fccac143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb146e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccac145b10 0x7fccac15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:33.996 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccabfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac0d2270 0x7fccac15b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:45270/0 (socket says 172.21.15.163:45270) 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccabfff640 1 -- 172.21.15.163:0/4275029639 learned_addr learned my addr 172.21.15.163:0/4275029639 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb146e640 1 -- 172.21.15.163:0/4275029639 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac0d2270 msgr2=0x7fccac15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb146e640 1 --2- 172.21.15.163:0/4275029639 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac0d2270 0x7fccac15b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb146e640 1 -- 172.21.15.163:0/4275029639 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0b0ba0 msgr2=0x7fccac143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb146e640 1 --2- 172.21.15.163:0/4275029639 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0b0ba0 0x7fccac143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb146e640 1 -- 172.21.15.163:0/4275029639 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac14cd40 con 0x7fccac145b10 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccabfff640 1 --2- 172.21.15.163:0/4275029639 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac0d2270 0x7fccac15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb146e640 1 --2- 172.21.15.163:0/4275029639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccac145b10 0x7fccac15ba40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcca400c730 tx=0x7fcca400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fcca97fa640 1 -- 172.21.15.163:0/4275029639 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4003b70 con 0x7fccac145b10 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fcca97fa640 1 -- 172.21.15.163:0/4275029639 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca4003d10 con 0x7fccac145b10 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb2ed1640 1 -- 172.21.15.163:0/4275029639 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccac14d020 con 0x7fccac145b10 2024-05-08T10:23:33.997 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fcca97fa640 1 -- 172.21.15.163:0/4275029639 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca400aa70 con 0x7fccac145b10 2024-05-08T10:23:33.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fccb2ed1640 1 -- 172.21.15.163:0/4275029639 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccac144230 con 0x7fccac145b10 2024-05-08T10:23:33.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fcca97fa640 1 -- 172.21.15.163:0/4275029639 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcca400ac10 con 0x7fccac145b10 2024-05-08T10:23:33.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.008+0000 7fcca97fa640 1 -- 172.21.15.163:0/4275029639 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fcca4012a60 con 0x7fccac145b10 2024-05-08T10:23:33.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.009+0000 7fccb2ed1640 1 -- 172.21.15.163:0/4275029639 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccac06a550 con 0x7fccac145b10 2024-05-08T10:23:33.998 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.011+0000 7fcca97fa640 1 -- 172.21.15.163:0/4275029639 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fcca4012d40 con 0x7fccac145b10 2024-05-08T10:23:33.999 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:34.014+0000 7f5e28921040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T10:23:34.063 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:34.078+0000 7f1a177b8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T10:23:34.069 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.084+0000 7fccb2ed1640 1 -- 172.21.15.163:0/4275029639 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6fdee42-f63f-4b77-ba34-0c148cc4075a", "id": 6} v 0) -- 0x7fccac0b5610 con 0x7fccac145b10 2024-05-08T10:23:34.072 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.087+0000 7fcca97fa640 1 -- 172.21.15.163:0/4275029639 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6fdee42-f63f-4b77-ba34-0c148cc4075a", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fcca4012470 con 0x7fccac145b10 2024-05-08T10:23:34.072 INFO:teuthology.orchestra.run.smithi163.stdout:6 2024-05-08T10:23:34.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.088+0000 7fccb2ed1640 1 -- 172.21.15.163:0/4275029639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccac145b10 msgr2=0x7fccac15ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.088+0000 7fccb2ed1640 1 --2- 172.21.15.163:0/4275029639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccac145b10 0x7fccac15ba40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcca400c730 tx=0x7fcca400cbf0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.088+0000 7fccb2ed1640 1 -- 172.21.15.163:0/4275029639 shutdown_connections 2024-05-08T10:23:34.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.088+0000 7fccb2ed1640 1 --2- 172.21.15.163:0/4275029639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccac145b10 0x7fccac15ba40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.088+0000 7fccb2ed1640 1 --2- 172.21.15.163:0/4275029639 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fccac0d2270 0x7fccac15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.088+0000 7fccb2ed1640 1 --2- 172.21.15.163:0/4275029639 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0b0ba0 0x7fccac143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.088+0000 7fccb2ed1640 1 -- 172.21.15.163:0/4275029639 >> 172.21.15.163:0/4275029639 conn(0x7fccac06d610 msgr2=0x7fccac06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:34.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.088+0000 7fccb2ed1640 1 -- 172.21.15.163:0/4275029639 shutdown_connections 2024-05-08T10:23:34.074 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.088+0000 7fccb2ed1640 1 -- 172.21.15.163:0/4275029639 wait complete. 2024-05-08T10:23:34.084 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 23536821-eb72-4083-a0ce-7ebefa5d7403 7 2024-05-08T10:23:34.116 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:34.131+0000 7f5e28921040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T10:23:34.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.231+0000 7fe15b23f640 1 Processor -- start 2024-05-08T10:23:34.216 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.231+0000 7fe15b23f640 1 -- start start 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.231+0000 7fe15b23f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe154073d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.231+0000 7fe15b23f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe1540d2180 0x7fe1540d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.231+0000 7fe15b23f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1540b12b0 con 0x7fe1541563d0 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.231+0000 7fe15b23f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe1540d2b10 con 0x7fe1540d2180 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.231+0000 7fe15b23f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe15415fe70 con 0x7fe1540b0db0 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe158fdb640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fe1541563d0 0x7fe154160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:50244/0 (socket says 172.21.15.163:50244) 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe158fdb640 1 -- 172.21.15.163:0/1200428504 learned_addr learned my addr 172.21.15.163:0/1200428504 (peer_addr_for_me v1:172.21.15.163:0/0) 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe153fff640 1 --2- 172.21.15.163:0/1200428504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe154073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe1597dc640 1 --2- 172.21.15.163:0/1200428504 >> v2:172.21.15.143:3300/0 conn(0x7fe1540d2180 0x7fe1540d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe1537fe640 1 -- 172.21.15.163:0/1200428504 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 541636024 0 0) 0x7fe1540b12b0 con 0x7fe1541563d0 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe1537fe640 1 -- 172.21.15.163:0/1200428504 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe144003520 con 0x7fe1541563d0 2024-05-08T10:23:34.219 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe153fff640 1 -- 172.21.15.163:0/1200428504 >> v2:172.21.15.143:3300/0 conn(0x7fe1540d2180 msgr2=0x7fe1540d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe153fff640 1 --2- 172.21.15.163:0/1200428504 >> v2:172.21.15.143:3300/0 conn(0x7fe1540d2180 0x7fe1540d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe153fff640 1 -- 172.21.15.163:0/1200428504 >> v1:172.21.15.163:6789/0 conn(0x7fe1541563d0 legacy=0x7fe154160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.232+0000 7fe153fff640 1 -- 172.21.15.163:0/1200428504 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1540b1590 con 0x7fe1540b0db0 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe153fff640 1 --2- 172.21.15.163:0/1200428504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe154073d40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe1400097a0 tx=0x7fe14002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e58b7aacba351dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe1537fe640 1 -- 172.21.15.163:0/1200428504 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140037070 con 0x7fe1540b0db0 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe1537fe640 1 -- 172.21.15.163:0/1200428504 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe140032440 con 0x7fe1540b0db0 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe1537fe640 1 -- 172.21.15.163:0/1200428504 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140032810 con 0x7fe1540b0db0 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe15b23f640 1 -- 172.21.15.163:0/1200428504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 msgr2=0x7fe154073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe15b23f640 1 --2- 172.21.15.163:0/1200428504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe154073d40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe1400097a0 tx=0x7fe14002a180 comp rx=0 tx=0).stop 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe15b23f640 1 -- 172.21.15.163:0/1200428504 shutdown_connections 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe15b23f640 1 --2- 172.21.15.163:0/1200428504 >> v2:172.21.15.143:3300/0 conn(0x7fe1540d2180 0x7fe1540d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe15b23f640 1 --2- 172.21.15.163:0/1200428504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe154073d40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.220 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe15b23f640 1 -- 172.21.15.163:0/1200428504 >> 172.21.15.163:0/1200428504 conn(0x7fe15406d610 msgr2=0x7fe15406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:34.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.233+0000 7fe15b23f640 1 -- 172.21.15.163:0/1200428504 shutdown_connections 2024-05-08T10:23:34.221 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.234+0000 7fe15b23f640 1 -- 172.21.15.163:0/1200428504 wait complete. 2024-05-08T10:23:34.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.235+0000 7fe15b23f640 1 Processor -- start 2024-05-08T10:23:34.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.235+0000 7fe15b23f640 1 -- start start 2024-05-08T10:23:34.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.235+0000 7fe15b23f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe1541f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.235+0000 7fe15b23f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1540d2180 0x7fe1540b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe15b23f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1541563d0 0x7fe1540700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe15b23f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe154074280 con 0x7fe1541563d0 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe15b23f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe1540b1870 con 0x7fe1540d2180 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe15b23f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe1541567b0 con 0x7fe1540b0db0 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe158fdb640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe1541f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe153fff640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1540d2180 0x7fe1540b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe158fdb640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe1541f4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:45276/0 (socket says 172.21.15.163:45276) 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe158fdb640 1 -- 172.21.15.163:0/2154763194 learned_addr learned my addr 172.21.15.163:0/2154763194 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe1597dc640 1 --2- 172.21.15.163:0/2154763194 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1541563d0 0x7fe1540700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe158fdb640 1 -- 172.21.15.163:0/2154763194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1540d2180 msgr2=0x7fe1540b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe158fdb640 1 --2- 172.21.15.163:0/2154763194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1540d2180 0x7fe1540b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe158fdb640 1 -- 172.21.15.163:0/2154763194 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1541563d0 msgr2=0x7fe1540700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.224 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe158fdb640 1 --2- 172.21.15.163:0/2154763194 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1541563d0 0x7fe1540700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe158fdb640 1 -- 172.21.15.163:0/2154763194 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1540b3340 con 0x7fe1540b0db0 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe153fff640 1 --2- 172.21.15.163:0/2154763194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1540d2180 0x7fe1540b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe158fdb640 1 --2- 172.21.15.163:0/2154763194 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe1541f4dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c530 tx=0x7fe14800c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe1517fa640 1 -- 172.21.15.163:0/2154763194 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148017070 con 0x7fe1540b0db0 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe1517fa640 1 -- 172.21.15.163:0/2154763194 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe148005ce0 con 0x7fe1540b0db0 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe1517fa640 1 -- 172.21.15.163:0/2154763194 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148007270 con 0x7fe1540b0db0 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe15b23f640 1 -- 172.21.15.163:0/2154763194 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1540b3620 con 0x7fe1540b0db0 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe15b23f640 1 -- 172.21.15.163:0/2154763194 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15414e730 con 0x7fe1540b0db0 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe1517fa640 1 -- 172.21.15.163:0/2154763194 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe14801a070 con 0x7fe1540b0db0 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.236+0000 7fe1517fa640 1 -- 172.21.15.163:0/2154763194 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fe14801cb70 con 0x7fe1540b0db0 2024-05-08T10:23:34.225 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.237+0000 7fe15b23f640 1 -- 172.21.15.163:0/2154763194 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe15414eb70 con 0x7fe1540b0db0 2024-05-08T10:23:34.226 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.239+0000 7fe1517fa640 1 -- 172.21.15.163:0/2154763194 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe148007410 con 0x7fe1540b0db0 2024-05-08T10:23:34.295 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.310+0000 7fe15b23f640 1 -- 172.21.15.163:0/2154763194 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "23536821-eb72-4083-a0ce-7ebefa5d7403", "id": 7} v 0) -- 0x7fe15406a550 con 0x7fe1540b0db0 2024-05-08T10:23:34.301 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.316+0000 7fe1517fa640 1 -- 172.21.15.163:0/2154763194 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23536821-eb72-4083-a0ce-7ebefa5d7403", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fe1480076c0 con 0x7fe1540b0db0 2024-05-08T10:23:34.301 INFO:teuthology.orchestra.run.smithi163.stdout:7 2024-05-08T10:23:34.302 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.317+0000 7fe15b23f640 1 -- 172.21.15.163:0/2154763194 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 msgr2=0x7fe1541f4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.303 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.317+0000 7fe15b23f640 1 --2- 172.21.15.163:0/2154763194 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe1541f4dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c530 tx=0x7fe14800c9f0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.303 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.317+0000 7fe15b23f640 1 -- 172.21.15.163:0/2154763194 shutdown_connections 2024-05-08T10:23:34.303 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.317+0000 7fe15b23f640 1 --2- 172.21.15.163:0/2154763194 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1541563d0 0x7fe1540700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.303 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.317+0000 7fe15b23f640 1 --2- 172.21.15.163:0/2154763194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1540d2180 0x7fe1540b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.303 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.317+0000 7fe15b23f640 1 --2- 172.21.15.163:0/2154763194 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1540b0db0 0x7fe1541f4dd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.303 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.317+0000 7fe15b23f640 1 -- 172.21.15.163:0/2154763194 >> 172.21.15.163:0/2154763194 conn(0x7fe15406d610 msgr2=0x7fe1540b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:34.303 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.317+0000 7fe15b23f640 1 -- 172.21.15.163:0/2154763194 shutdown_connections 2024-05-08T10:23:34.303 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:23:34.317+0000 7fe15b23f640 1 -- 172.21.15.163:0/2154763194 wait complete. 2024-05-08T10:23:34.313 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T10:23:34.313 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T10:23:34.315 INFO:tasks.ceph.osd.0:Started 2024-05-08T10:23:34.315 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T10:23:34.315 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T10:23:34.317 INFO:tasks.ceph.osd.1:Started 2024-05-08T10:23:34.317 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T10:23:34.317 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T10:23:34.319 INFO:tasks.ceph.osd.2:Started 2024-05-08T10:23:34.319 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T10:23:34.320 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T10:23:34.322 INFO:tasks.ceph.osd.3:Started 2024-05-08T10:23:34.322 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T10:23:34.322 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T10:23:34.324 INFO:tasks.ceph.osd.4:Started 2024-05-08T10:23:34.324 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T10:23:34.324 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T10:23:34.326 INFO:tasks.ceph.osd.5:Started 2024-05-08T10:23:34.326 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T10:23:34.327 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T10:23:34.328 INFO:tasks.ceph.osd.6:Started 2024-05-08T10:23:34.329 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T10:23:34.329 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T10:23:34.331 INFO:tasks.ceph.osd.7:Started 2024-05-08T10:23:34.331 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:23:34.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.491+0000 7f7becdaf640 1 Processor -- start 2024-05-08T10:23:34.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.491+0000 7f7becdaf640 1 -- start start 2024-05-08T10:23:34.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.492+0000 7f7becdaf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7be81423d0 0x7f7be8142a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.492+0000 7f7becdaf640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 0x7f7be80d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.492+0000 7f7becdaf640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be8144d50 con 0x7f7be80d3490 2024-05-08T10:23:34.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.492+0000 7f7becdaf640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7be8145030 con 0x7f7be81423d0 2024-05-08T10:23:34.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.492+0000 7f7becdaf640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7be8145310 con 0x7f7be8163870 2024-05-08T10:23:34.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.492+0000 7f7be659c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7be81423d0 0x7f7be8142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.492+0000 7f7be6d9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7be80d3490 0x7f7be8072090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49706/0 (socket says 172.21.15.143:49706) 2024-05-08T10:23:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.492+0000 7f7be6d9d640 1 -- 172.21.15.143:0/2741598703 learned_addr learned my addr 172.21.15.143:0/2741598703 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.493+0000 7f7bdffff640 1 --2- 172.21.15.143:0/2741598703 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 0x7f7be80d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.493+0000 7f7be659c640 1 -- 172.21.15.143:0/2741598703 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 msgr2=0x7f7be80d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.493+0000 7f7be659c640 1 --2- 172.21.15.143:0/2741598703 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 0x7f7be80d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.493+0000 7f7be659c640 1 -- 172.21.15.143:0/2741598703 >> v1:172.21.15.143:6789/0 conn(0x7f7be80d3490 legacy=0x7f7be8072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.493+0000 7f7be5d9b640 1 -- 172.21.15.143:0/2741598703 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1070525074 0 0) 0x7f7be8144d50 con 0x7f7be80d3490 2024-05-08T10:23:34.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.493+0000 7f7be659c640 1 -- 172.21.15.143:0/2741598703 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be81455f0 con 0x7f7be81423d0 2024-05-08T10:23:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.493+0000 7f7be659c640 1 --2- 172.21.15.143:0/2741598703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 0x7f7be8142a20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80097a0 tx=0x7f7bd802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c817645dcf250b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7be5d9b640 1 -- 172.21.15.143:0/2741598703 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8037070 con 0x7f7be81423d0 2024-05-08T10:23:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7be5d9b640 1 -- 172.21.15.143:0/2741598703 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd8032440 con 0x7f7be81423d0 2024-05-08T10:23:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7be5d9b640 1 -- 172.21.15.143:0/2741598703 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8032810 con 0x7f7be81423d0 2024-05-08T10:23:34.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7becdaf640 1 -- 172.21.15.143:0/2741598703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 msgr2=0x7f7be8142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7becdaf640 1 --2- 172.21.15.143:0/2741598703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 0x7f7be8142a20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80097a0 tx=0x7f7bd802a180 comp rx=0 tx=0).stop 2024-05-08T10:23:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7becdaf640 1 -- 172.21.15.143:0/2741598703 shutdown_connections 2024-05-08T10:23:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7becdaf640 1 --2- 172.21.15.143:0/2741598703 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 0x7f7be80d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7becdaf640 1 --2- 172.21.15.143:0/2741598703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 0x7f7be8142a20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7becdaf640 1 -- 172.21.15.143:0/2741598703 >> 172.21.15.143:0/2741598703 conn(0x7f7be80b4da0 msgr2=0x7f7be80b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7becdaf640 1 -- 172.21.15.143:0/2741598703 shutdown_connections 2024-05-08T10:23:34.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.494+0000 7f7becdaf640 1 -- 172.21.15.143:0/2741598703 wait complete. 2024-05-08T10:23:34.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.496+0000 7f7becdaf640 1 Processor -- start 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.496+0000 7f7becdaf640 1 -- start start 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.496+0000 7f7becdaf640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7be80d3490 0x7f7be80cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.496+0000 7f7becdaf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 0x7f7be80cf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.496+0000 7f7becdaf640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 0x7f7be8141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.496+0000 7f7becdaf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8163e50 con 0x7f7be81423d0 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.496+0000 7f7becdaf640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8163cd0 con 0x7f7be80d3490 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.496+0000 7f7becdaf640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7be81630f0 con 0x7f7be8163870 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 0x7f7be80cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 0x7f7be80cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55642/0 (socket says 172.21.15.143:55642) 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdffff640 1 -- 172.21.15.143:0/1666808682 learned_addr learned my addr 172.21.15.143:0/1666808682 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7be659c640 1 --2- 172.21.15.143:0/1666808682 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7be80d3490 0x7f7be80cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7be6d9d640 1 --2- 172.21.15.143:0/1666808682 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 0x7f7be8141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdffff640 1 -- 172.21.15.143:0/1666808682 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 msgr2=0x7f7be8141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdffff640 1 --2- 172.21.15.143:0/1666808682 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 0x7f7be8141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdffff640 1 -- 172.21.15.143:0/1666808682 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7be80d3490 msgr2=0x7f7be80cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdffff640 1 --2- 172.21.15.143:0/1666808682 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7be80d3490 0x7f7be80cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdffff640 1 -- 172.21.15.143:0/1666808682 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80ce010 con 0x7f7be81423d0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdffff640 1 --2- 172.21.15.143:0/1666808682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 0x7f7be80cf890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000e870 tx=0x7f7bd000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdeffd640 1 -- 172.21.15.143:0/1666808682 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0017070 con 0x7f7be81423d0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdeffd640 1 -- 172.21.15.143:0/1666808682 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd000c940 con 0x7f7be81423d0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7becdaf640 1 -- 172.21.15.143:0/1666808682 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be80ce2f0 con 0x7f7be81423d0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdeffd640 1 -- 172.21.15.143:0/1666808682 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000cd30 con 0x7f7be81423d0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7becdaf640 1 -- 172.21.15.143:0/1666808682 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be80ce8b0 con 0x7f7be81423d0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.497+0000 7f7bdeffd640 1 -- 172.21.15.143:0/1666808682 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7bd001a070 con 0x7f7be81423d0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.498+0000 7f7bdeffd640 1 -- 172.21.15.143:0/1666808682 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7bd0013b40 con 0x7f7be81423d0 2024-05-08T10:23:34.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.498+0000 7f7becdaf640 1 -- 172.21.15.143:0/1666808682 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be806a550 con 0x7f7be81423d0 2024-05-08T10:23:34.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.500+0000 7f7bdeffd640 1 -- 172.21.15.143:0/1666808682 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7bd0013e20 con 0x7f7be81423d0 2024-05-08T10:23:34.503 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:34.518+0000 7f1a177b8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T10:23:34.538 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:34.553+0000 7f5e28921040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T10:23:34.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.562+0000 7f7becdaf640 1 -- 172.21.15.143:0/1666808682 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7be80b5a40 con 0x7f7be81423d0 2024-05-08T10:23:34.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.563+0000 7f7bdeffd640 1 -- 172.21.15.143:0/1666808682 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7bd00064d0 con 0x7f7be81423d0 2024-05-08T10:23:34.548 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:34.548 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":10,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:34.312126+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:23:34.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.563+0000 7f7becdaf640 1 -- 172.21.15.143:0/1666808682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 msgr2=0x7f7be80cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:34.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.563+0000 7f7becdaf640 1 --2- 172.21.15.143:0/1666808682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 0x7f7be80cf890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000e870 tx=0x7f7bd000ed30 comp rx=0 tx=0).stop 2024-05-08T10:23:34.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.564+0000 7f7becdaf640 1 -- 172.21.15.143:0/1666808682 shutdown_connections 2024-05-08T10:23:34.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.564+0000 7f7becdaf640 1 --2- 172.21.15.143:0/1666808682 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7be8163870 0x7f7be8141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.564+0000 7f7becdaf640 1 --2- 172.21.15.143:0/1666808682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7be81423d0 0x7f7be80cf890 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.564+0000 7f7becdaf640 1 --2- 172.21.15.143:0/1666808682 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7be80d3490 0x7f7be80cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:34.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.564+0000 7f7becdaf640 1 -- 172.21.15.143:0/1666808682 >> 172.21.15.143:0/1666808682 conn(0x7f7be80b4da0 msgr2=0x7f7be8070610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:34.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.564+0000 7f7becdaf640 1 -- 172.21.15.143:0/1666808682 shutdown_connections 2024-05-08T10:23:34.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:34.564+0000 7f7becdaf640 1 -- 172.21.15.143:0/1666808682 wait complete. 2024-05-08T10:23:34.559 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T10:23:34.560 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T10:23:34.645 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:34.660+0000 7f1a177b8040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T10:23:34.676 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:34.691+0000 7f5e28921040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T10:23:34.906 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:34.921+0000 7f1a177b8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T10:23:34.920 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-08T10:23:34.935+0000 7f5d5001a640 -1 Falling back to public interface 2024-05-08T10:23:34.923 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-05-08T10:23:34.938+0000 7f5fcba12640 -1 Falling back to public interface 2024-05-08T10:23:34.927 INFO:tasks.ceph.osd.2.smithi143.stderr:2024-05-08T10:23:34.942+0000 7f9e3b92a640 -1 Falling back to public interface 2024-05-08T10:23:34.929 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-08T10:23:34.944+0000 7fca1d213640 -1 Falling back to public interface 2024-05-08T10:23:34.932 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-05-08T10:23:34.947+0000 7ffa935a7640 -1 Falling back to public interface 2024-05-08T10:23:34.935 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:34.950+0000 7f5e28921040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T10:23:34.941 INFO:tasks.ceph.osd.3.smithi143.stderr:2024-05-08T10:23:34.956+0000 7fdf0fe2e640 -1 Falling back to public interface 2024-05-08T10:23:34.946 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-08T10:23:34.961+0000 7fb8a4721640 -1 Falling back to public interface 2024-05-08T10:23:34.958 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-08T10:23:34.973+0000 7fef482b5640 -1 Falling back to public interface 2024-05-08T10:23:34.970 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:34.985+0000 7f1a177b8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T10:23:34.990 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:35.005+0000 7f5e28921040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T10:23:35.086 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:35.101+0000 7f1a177b8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T10:23:35.105 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:35.120+0000 7f5e28921040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T10:23:35.365 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T10:23:35.386 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:35.401+0000 7f1a177b8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T10:23:35.414 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:35.425+0000 7f5e28921040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T10:23:35.436 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:35.451+0000 7f1a177b8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T10:23:35.457 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.472+0000 7fbb583b6640 1 Processor -- start 2024-05-08T10:23:35.457 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.472+0000 7fbb583b6640 1 -- start start 2024-05-08T10:23:35.459 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb583b6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb50148b90 0x7fbb500b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:35.459 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb583b6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 0x7fbb5006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:35.459 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb583b6640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb50163760 con 0x7fbb50148610 2024-05-08T10:23:35.459 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb583b6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbb501489f0 con 0x7fbb50148b90 2024-05-08T10:23:35.459 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb583b6640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbb500b57b0 con 0x7fbb500b5340 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb55951640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb50148b90 0x7fbb500b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb55951640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb50148b90 0x7fbb500b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55654/0 (socket says 172.21.15.143:55654) 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb55951640 1 -- 172.21.15.143:0/2794844932 learned_addr learned my addr 172.21.15.143:0/2794844932 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb56953640 1 --2- 172.21.15.143:0/2794844932 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 0x7fbb5006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb55951640 1 -- 172.21.15.143:0/2794844932 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 msgr2=0x7fbb5006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb55951640 1 --2- 172.21.15.143:0/2794844932 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 0x7fbb5006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb55951640 1 -- 172.21.15.143:0/2794844932 >> v1:172.21.15.163:6789/0 conn(0x7fbb50148610 legacy=0x7fbb50162ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.473+0000 7fbb55951640 1 -- 172.21.15.143:0/2794844932 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb50163a40 con 0x7fbb50148b90 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.474+0000 7fbb55951640 1 --2- 172.21.15.143:0/2794844932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148b90 0x7fbb500b4e00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91407369f7db3e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.474+0000 7fbb55150640 1 -- 172.21.15.143:0/2794844932 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40037070 con 0x7fbb50148b90 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.474+0000 7fbb55150640 1 -- 172.21.15.143:0/2794844932 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb40032440 con 0x7fbb50148b90 2024-05-08T10:23:35.460 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.474+0000 7fbb55150640 1 -- 172.21.15.143:0/2794844932 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40032810 con 0x7fbb50148b90 2024-05-08T10:23:35.461 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:35.473+0000 7f5e28921040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T10:23:35.464 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.475+0000 7fbb583b6640 1 -- 172.21.15.143:0/2794844932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148b90 msgr2=0x7fbb500b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:35.464 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.475+0000 7fbb583b6640 1 --2- 172.21.15.143:0/2794844932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148b90 0x7fbb500b4e00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002a270 comp rx=0 tx=0).stop 2024-05-08T10:23:35.464 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.475+0000 7fbb583b6640 1 -- 172.21.15.143:0/2794844932 shutdown_connections 2024-05-08T10:23:35.464 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.475+0000 7fbb583b6640 1 --2- 172.21.15.143:0/2794844932 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 0x7fbb5006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:35.464 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.475+0000 7fbb583b6640 1 --2- 172.21.15.143:0/2794844932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148b90 0x7fbb500b4e00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:35.464 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.475+0000 7fbb583b6640 1 -- 172.21.15.143:0/2794844932 >> 172.21.15.143:0/2794844932 conn(0x7fbb50068320 msgr2=0x7fbb50068730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:35.464 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.475+0000 7fbb583b6640 1 -- 172.21.15.143:0/2794844932 shutdown_connections 2024-05-08T10:23:35.464 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.475+0000 7fbb583b6640 1 -- 172.21.15.143:0/2794844932 wait complete. 2024-05-08T10:23:35.464 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.476+0000 7fbb583b6640 1 Processor -- start 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.476+0000 7fbb583b6640 1 -- start start 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb583b6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 0x7fbb501613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb583b6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148610 0x7fbb501f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb583b6640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb50148b90 0x7fbb501607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb583b6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5006d440 con 0x7fbb50148610 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb583b6640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5006d7b0 con 0x7fbb50148b90 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb583b6640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbb500cf9f0 con 0x7fbb500b5340 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb55951640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148610 0x7fbb501f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb55951640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148610 0x7fbb501f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55660/0 (socket says 172.21.15.143:55660) 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb55951640 1 -- 172.21.15.143:0/133572990 learned_addr learned my addr 172.21.15.143:0/133572990 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb56152640 1 --2- 172.21.15.143:0/133572990 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 0x7fbb501613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb56953640 1 --2- 172.21.15.143:0/133572990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb50148b90 0x7fbb501607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb55951640 1 -- 172.21.15.143:0/133572990 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 msgr2=0x7fbb501613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:35.465 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb55951640 1 --2- 172.21.15.143:0/133572990 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 0x7fbb501613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb55951640 1 -- 172.21.15.143:0/133572990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb50148b90 msgr2=0x7fbb501607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb55951640 1 --2- 172.21.15.143:0/133572990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb50148b90 0x7fbb501607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb55951640 1 -- 172.21.15.143:0/133572990 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb500cd060 con 0x7fbb50148610 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb55951640 1 --2- 172.21.15.143:0/133572990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148610 0x7fbb501f4380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbb4002a2b0 tx=0x7fbb400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb46ffd640 1 -- 172.21.15.143:0/133572990 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40041030 con 0x7fbb50148610 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.477+0000 7fbb46ffd640 1 -- 172.21.15.143:0/133572990 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb40030440 con 0x7fbb50148610 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.478+0000 7fbb46ffd640 1 -- 172.21.15.143:0/133572990 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40037040 con 0x7fbb50148610 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.478+0000 7fbb583b6640 1 -- 172.21.15.143:0/133572990 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb500cd340 con 0x7fbb50148610 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.478+0000 7fbb583b6640 1 -- 172.21.15.143:0/133572990 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb500cd900 con 0x7fbb50148610 2024-05-08T10:23:35.466 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.478+0000 7fbb46ffd640 1 -- 172.21.15.143:0/133572990 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb40044070 con 0x7fbb50148610 2024-05-08T10:23:35.468 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.478+0000 7fbb46ffd640 1 -- 172.21.15.143:0/133572990 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbb4003dcd0 con 0x7fbb50148610 2024-05-08T10:23:35.468 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.479+0000 7fbb583b6640 1 -- 172.21.15.143:0/133572990 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb50050740 con 0x7fbb50148610 2024-05-08T10:23:35.468 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.481+0000 7fbb46ffd640 1 -- 172.21.15.143:0/133572990 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbb4003d600 con 0x7fbb50148610 2024-05-08T10:23:35.528 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.542+0000 7fbb583b6640 1 -- 172.21.15.143:0/133572990 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb5006f650 con 0x7fbb50148610 2024-05-08T10:23:35.528 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.543+0000 7fbb46ffd640 1 -- 172.21.15.143:0/133572990 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbb4003d7e0 con 0x7fbb50148610 2024-05-08T10:23:35.528 INFO:teuthology.misc.health.smithi143.stdout: 2024-05-08T10:23:35.529 INFO:teuthology.misc.health.smithi143.stdout:{"epoch":10,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:34.312126+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:23:35.530 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.544+0000 7fbb583b6640 1 -- 172.21.15.143:0/133572990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148610 msgr2=0x7fbb501f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:35.530 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.544+0000 7fbb583b6640 1 --2- 172.21.15.143:0/133572990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148610 0x7fbb501f4380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbb4002a2b0 tx=0x7fbb400046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:35.530 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.544+0000 7fbb583b6640 1 -- 172.21.15.143:0/133572990 shutdown_connections 2024-05-08T10:23:35.530 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.544+0000 7fbb583b6640 1 --2- 172.21.15.143:0/133572990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb50148b90 0x7fbb501607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:35.530 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.544+0000 7fbb583b6640 1 --2- 172.21.15.143:0/133572990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb50148610 0x7fbb501f4380 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:35.530 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.544+0000 7fbb583b6640 1 --2- 172.21.15.143:0/133572990 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb500b5340 0x7fbb501613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:35.530 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.544+0000 7fbb583b6640 1 -- 172.21.15.143:0/133572990 >> 172.21.15.143:0/133572990 conn(0x7fbb50068320 msgr2=0x7fbb50147370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:35.530 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.544+0000 7fbb583b6640 1 -- 172.21.15.143:0/133572990 shutdown_connections 2024-05-08T10:23:35.530 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:35.544+0000 7fbb583b6640 1 -- 172.21.15.143:0/133572990 wait complete. 2024-05-08T10:23:35.543 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T10:23:35.604 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:35.619+0000 7f1a177b8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T10:23:35.618 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:35.633+0000 7f5e28921040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T10:23:35.741 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:35.756+0000 7f1a177b8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T10:23:35.755 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:35.770+0000 7f5e28921040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T10:23:35.792 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:35.807+0000 7f1a177b8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T10:23:35.806 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:35.821+0000 7f5e28921040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T10:23:35.861 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:35.876+0000 7f1a177b8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T10:23:35.876 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:35.891+0000 7f5e28921040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T10:23:35.906 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:35.921+0000 7f1a177b8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T10:23:35.921 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:35.936+0000 7f5e28921040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T10:23:36.387 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:36.402+0000 7f1a177b8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T10:23:36.404 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:36.419+0000 7f5e28921040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T10:23:36.501 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:36.516+0000 7f1a177b8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T10:23:36.521 INFO:tasks.ceph.mgr.x.smithi163.stderr:2024-05-08T10:23:36.536+0000 7f5e28921040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T10:23:37.514 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:37.529+0000 7f19b7b72640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T10:23:37.515 INFO:tasks.ceph.mgr.y.smithi143.stderr:2024-05-08T10:23:37.529+0000 7f19b7b72640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T10:23:38.389 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-05-08T10:23:38.404+0000 7f5fcba12640 -1 osd.0 0 log_to_monitors true 2024-05-08T10:23:38.392 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-08T10:23:38.407+0000 7f5d5001a640 -1 osd.5 0 log_to_monitors true 2024-05-08T10:23:38.441 INFO:tasks.ceph.osd.3.smithi143.stderr:2024-05-08T10:23:38.456+0000 7fdf0fe2e640 -1 osd.3 0 log_to_monitors true 2024-05-08T10:23:38.448 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-08T10:23:38.463+0000 7fef482b5640 -1 osd.6 0 log_to_monitors true 2024-05-08T10:23:38.449 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-08T10:23:38.464+0000 7fb8a4721640 -1 osd.7 0 log_to_monitors true 2024-05-08T10:23:38.449 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-08T10:23:38.464+0000 7fca1d213640 -1 osd.4 0 log_to_monitors true 2024-05-08T10:23:38.471 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-05-08T10:23:38.486+0000 7ffa935a7640 -1 osd.1 0 log_to_monitors true 2024-05-08T10:23:38.471 INFO:tasks.ceph.osd.2.smithi143.stderr:2024-05-08T10:23:38.486+0000 7f9e3b92a640 -1 osd.2 0 log_to_monitors true 2024-05-08T10:23:41.118 INFO:tasks.ceph.osd.2.smithi143.stderr:2024-05-08T10:23:41.132+0000 7f9e378c0640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T10:23:41.147 INFO:tasks.ceph.osd.2.smithi143.stderr:2024-05-08T10:23:41.162+0000 7f9e2f6e0640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:23:41.151 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-05-08T10:23:41.166+0000 7ffa8f53d640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T10:23:41.249 INFO:tasks.ceph.osd.1.smithi143.stderr:2024-05-08T10:23:41.264+0000 7ffa8735d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:23:41.493 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-08T10:23:41.507+0000 7fef4424b640 -1 osd.6 0 waiting for initial osdmap 2024-05-08T10:23:41.508 INFO:tasks.ceph.osd.6.smithi163.stderr:2024-05-08T10:23:41.523+0000 7fef3c06b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:23:41.537 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-08T10:23:41.552+0000 7f5d4b9a0640 -1 osd.5 0 waiting for initial osdmap 2024-05-08T10:23:41.546 INFO:tasks.ceph.osd.5.smithi163.stderr:2024-05-08T10:23:41.561+0000 7f5d437c0640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:23:41.566 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-08T10:23:41.581+0000 7fb8a06b7640 -1 osd.7 0 waiting for initial osdmap 2024-05-08T10:23:41.579 INFO:tasks.ceph.osd.7.smithi163.stderr:2024-05-08T10:23:41.594+0000 7fb8984d7640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:23:41.591 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-08T10:23:41.606+0000 7fca18a8c640 -1 osd.4 0 waiting for initial osdmap 2024-05-08T10:23:41.606 INFO:tasks.ceph.osd.4.smithi163.stderr:2024-05-08T10:23:41.621+0000 7fca108ac640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:23:42.041 INFO:tasks.ceph.osd.3.smithi143.stderr:2024-05-08T10:23:42.056+0000 7fdf0b378640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T10:23:42.050 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-05-08T10:23:42.065+0000 7f5fc7451640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T10:23:42.056 INFO:tasks.ceph.osd.3.smithi143.stderr:2024-05-08T10:23:42.071+0000 7fdf03198640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:23:42.062 INFO:tasks.ceph.osd.0.smithi143.stderr:2024-05-08T10:23:42.077+0000 7f5fbf271640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:23:42.350 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T10:23:42.444 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.459+0000 7f58aba1d640 1 Processor -- start 2024-05-08T10:23:42.444 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.459+0000 7f58aba1d640 1 -- start start 2024-05-08T10:23:42.445 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58aba1d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f58a40b42f0 0x7f58a406ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.445 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58aba1d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a40b53e0 con 0x7f58a4145a30 2024-05-08T10:23:42.445 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58aba1d640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a40cf860 con 0x7f58a40b4f50 2024-05-08T10:23:42.446 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58aba1d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f58a40d02d0 con 0x7f58a40b42f0 2024-05-08T10:23:42.446 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58a9fba640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f58a40b42f0 0x7f58a406ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.446 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58a97b9640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f58a4145a30 0x7f58a40cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49716/0 (socket says 172.21.15.143:49716) 2024-05-08T10:23:42.446 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58a97b9640 1 -- 172.21.15.143:0/3956715198 learned_addr learned my addr 172.21.15.143:0/3956715198 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:42.446 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58a9fba640 1 -- 172.21.15.143:0/3956715198 >> v1:172.21.15.163:6789/0 conn(0x7f58a40b4f50 legacy=0x7f58a40b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.446 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58a9fba640 1 -- 172.21.15.143:0/3956715198 >> v1:172.21.15.143:6789/0 conn(0x7f58a4145a30 legacy=0x7f58a40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.446 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.460+0000 7f58a9fba640 1 -- 172.21.15.143:0/3956715198 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a40d05b0 con 0x7f58a40b42f0 2024-05-08T10:23:42.447 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.461+0000 7f58a9fba640 1 --2- 172.21.15.143:0/3956715198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b42f0 0x7f58a406ffb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f589c009dc0 tx=0x7f589c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a55ecf1753b8da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:42.447 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.461+0000 7f589bfff640 1 -- 172.21.15.143:0/3956715198 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c036020 con 0x7f58a40b42f0 2024-05-08T10:23:42.447 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.461+0000 7f589bfff640 1 -- 172.21.15.143:0/3956715198 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c032800 con 0x7f58a40b42f0 2024-05-08T10:23:42.448 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.461+0000 7f589bfff640 1 -- 172.21.15.143:0/3956715198 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c032bd0 con 0x7f58a40b42f0 2024-05-08T10:23:42.448 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.462+0000 7f58aba1d640 1 -- 172.21.15.143:0/3956715198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b42f0 msgr2=0x7f58a406ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.448 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.462+0000 7f58aba1d640 1 --2- 172.21.15.143:0/3956715198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b42f0 0x7f58a406ffb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f589c009dc0 tx=0x7f589c02c940 comp rx=0 tx=0).stop 2024-05-08T10:23:42.448 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.462+0000 7f58aba1d640 1 -- 172.21.15.143:0/3956715198 shutdown_connections 2024-05-08T10:23:42.448 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.462+0000 7f58aba1d640 1 --2- 172.21.15.143:0/3956715198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b42f0 0x7f58a406ffb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.448 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.462+0000 7f58aba1d640 1 -- 172.21.15.143:0/3956715198 >> 172.21.15.143:0/3956715198 conn(0x7f58a406d440 msgr2=0x7f58a406d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:42.448 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.462+0000 7f58aba1d640 1 -- 172.21.15.143:0/3956715198 shutdown_connections 2024-05-08T10:23:42.448 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.462+0000 7f58aba1d640 1 -- 172.21.15.143:0/3956715198 wait complete. 2024-05-08T10:23:42.450 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.463+0000 7f58aba1d640 1 Processor -- start 2024-05-08T10:23:42.450 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.463+0000 7f58aba1d640 1 -- start start 2024-05-08T10:23:42.450 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58aba1d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58a40b42f0 0x7f58a41f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58aba1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b4f50 0x7f58a413f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58aba1d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58a4145a30 0x7f58a40b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58aba1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f58a406fa90 con 0x7f58a40b4f50 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58aba1d640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f58a406f7b0 con 0x7f58a40b42f0 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58aba1d640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f58a4145e10 con 0x7f58a4145a30 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a8fb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b4f50 0x7f58a413f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a8fb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b4f50 0x7f58a413f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55788/0 (socket says 172.21.15.143:55788) 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a8fb8640 1 -- 172.21.15.143:0/993686795 learned_addr learned my addr 172.21.15.143:0/993686795 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a97b9640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58a40b42f0 0x7f58a41f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a9fba640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58a4145a30 0x7f58a40b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.451 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a8fb8640 1 -- 172.21.15.143:0/993686795 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58a4145a30 msgr2=0x7f58a40b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a8fb8640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58a4145a30 0x7f58a40b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a8fb8640 1 -- 172.21.15.143:0/993686795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58a40b42f0 msgr2=0x7f58a41f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a8fb8640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58a40b42f0 0x7f58a41f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a8fb8640 1 -- 172.21.15.143:0/993686795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a41f4860 con 0x7f58a40b4f50 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58a8fb8640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b4f50 0x7f58a413f070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f589400c450 tx=0x7f589400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f5899ffb640 1 -- 172.21.15.143:0/993686795 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58940052d0 con 0x7f58a40b4f50 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f5899ffb640 1 -- 172.21.15.143:0/993686795 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894005470 con 0x7f58a40b4f50 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a41f3560 con 0x7f58a40b4f50 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.464+0000 7f5899ffb640 1 -- 172.21.15.143:0/993686795 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894012870 con 0x7f58a40b4f50 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.465+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a41f3b20 con 0x7f58a40b4f50 2024-05-08T10:23:42.452 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.466+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a40cfe60 con 0x7f58a40b4f50 2024-05-08T10:23:42.453 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.466+0000 7f5899ffb640 1 -- 172.21.15.143:0/993686795 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f5894012a10 con 0x7f58a40b4f50 2024-05-08T10:23:42.453 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.466+0000 7f5899ffb640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5888076240 0x7f5888078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.453 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.466+0000 7f5899ffb640 1 -- 172.21.15.143:0/993686795 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f5894096c30 con 0x7f58a40b4f50 2024-05-08T10:23:42.453 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.466+0000 7f58a97b9640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5888076240 0x7f5888078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.454 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.467+0000 7f58a97b9640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5888076240 0x7f5888078700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f58a0000f60 tx=0x7f58a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:42.456 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.471+0000 7f5899ffb640 1 -- 172.21.15.143:0/993686795 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f58a40cfe60 con 0x7f58a40b4f50 2024-05-08T10:23:42.647 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.662+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58a4050740 con 0x7f58a40b4f50 2024-05-08T10:23:42.648 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.663+0000 7f5899ffb640 1 -- 172.21.15.143:0/993686795 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10945 (secure 0 0 0) 0x7f5894060b40 con 0x7f58a40b4f50 2024-05-08T10:23:42.648 INFO:teuthology.misc.health.smithi143.stdout: 2024-05-08T10:23:42.648 INFO:teuthology.misc.health.smithi143.stdout:{"epoch":13,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:42.147623+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5888076240 msgr2=0x7f5888078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5888076240 0x7f5888078700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f58a0000f60 tx=0x7f58a0009040 comp rx=0 tx=0).stop 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b4f50 msgr2=0x7f58a413f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b4f50 0x7f58a413f070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f589400c450 tx=0x7f589400c910 comp rx=0 tx=0).stop 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 shutdown_connections 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58a4145a30 0x7f58a40b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5888076240 0x7f5888078700 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58a40b4f50 0x7f58a413f070 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 --2- 172.21.15.143:0/993686795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58a40b42f0 0x7f58a41f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.651 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 >> 172.21.15.143:0/993686795 conn(0x7f58a406d440 msgr2=0x7f58a40b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:42.652 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 shutdown_connections 2024-05-08T10:23:42.652 INFO:teuthology.misc.health.smithi143.stderr:2024-05-08T10:23:42.665+0000 7f58aba1d640 1 -- 172.21.15.143:0/993686795 wait complete. 2024-05-08T10:23:42.660 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T10:23:42.660 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T10:23:42.661 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T10:23:42.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T10:23:42.663 INFO:tasks.ceph.mds.a:Started 2024-05-08T10:23:42.663 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T10:23:42.663 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T10:23:42.665 INFO:tasks.ceph.mds.c:Started 2024-05-08T10:23:42.665 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T10:23:42.665 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T10:23:42.668 INFO:tasks.ceph.mds.b:Started 2024-05-08T10:23:42.668 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T10:23:42.668 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T10:23:42.670 INFO:tasks.ceph.mds.d:Started 2024-05-08T10:23:42.671 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-08T10:23:42.671 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:23:42.739 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2024-05-08T10:23:42.739 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2024-05-08T10:23:42.755 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2024-05-08T10:23:42.755 INFO:tasks.ceph.mds.d.smithi163.stdout:starting mds.d at 2024-05-08T10:23:42.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.791+0000 7f988a2dc640 1 Processor -- start 2024-05-08T10:23:42.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.791+0000 7f988a2dc640 1 -- start start 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f988a2dc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f988415f760 0x7f98840b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f988a2dc640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f98840cfc10 0x7f98840d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f988a2dc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98840d0070 con 0x7f98840d0830 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f988a2dc640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f988415fb40 con 0x7f98840cfc10 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f988a2dc640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f98840d36f0 con 0x7f988415f760 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f9888879640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f98840d0830 0x7f98840b6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:49720/0 (socket says 172.21.15.143:49720) 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f9888879640 1 -- 172.21.15.143:0/1574114949 learned_addr learned my addr 172.21.15.143:0/1574114949 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f9883fff640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f988415f760 0x7f98840b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f98837fe640 1 --2- 172.21.15.143:0/1574114949 >> v2:172.21.15.163:3300/0 conn(0x7f98840cfc10 0x7f98840d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961056519 0 0) 0x7f987c001490 con 0x7f98840d0830 2024-05-08T10:23:42.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.792+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f986c003520 con 0x7f98840d0830 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2266197676 0 0) 0x7f986c003520 con 0x7f98840d0830 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f988415f760 msgr2=0x7f98840b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f988415f760 0x7f98840b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 >> v2:172.21.15.163:3300/0 conn(0x7f98840cfc10 msgr2=0x7f98840d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 --2- 172.21.15.143:0/1574114949 >> v2:172.21.15.163:3300/0 conn(0x7f98840cfc10 0x7f98840d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98840d39d0 con 0x7f98840d0830 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f987c001c40 con 0x7f98840d0830 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 >> v1:172.21.15.143:6789/0 conn(0x7f98840d0830 legacy=0x7f98840b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f986c003a00 0x7f986c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c004800 0x7f986c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c0051c0 0x7f986c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f988415fb40 con 0x7f986c003a00 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f98840d36f0 con 0x7f986c0051c0 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f986c00c140 con 0x7f986c004800 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9883fff640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f988415f760 0x7f98840b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f98837fe640 1 --2- 172.21.15.143:0/1574114949 >> v2:172.21.15.163:3300/0 conn(0x7f98840cfc10 0x7f98840d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9883fff640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f986c003a00 0x7f986c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9888879640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c0051c0 0x7f986c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f98837fe640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c004800 0x7f986c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9883fff640 1 -- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c004800 msgr2=0x7f986c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9883fff640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c004800 0x7f986c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9883fff640 1 -- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c0051c0 msgr2=0x7f986c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9883fff640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c0051c0 0x7f986c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f9883fff640 1 -- 172.21.15.143:0/1574114949 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c003520 con 0x7f986c003a00 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.793+0000 7f98837fe640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c004800 0x7f986c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.794+0000 7f9883fff640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f986c003a00 0x7f986c003e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9874006fd0 tx=0x7f986c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cb8b2b73113e00 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.794+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874037070 con 0x7f986c003a00 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.794+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f987402aae0 con 0x7f986c003a00 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.794+0000 7f9882ffd640 1 -- 172.21.15.143:0/1574114949 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987400f040 con 0x7f986c003a00 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.795+0000 7f988a2dc640 1 -- 172.21.15.143:0/1574114949 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f986c003a00 msgr2=0x7f986c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.795+0000 7f988a2dc640 1 --2- 172.21.15.143:0/1574114949 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f986c003a00 0x7f986c003e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9874006fd0 tx=0x7f986c005830 comp rx=0 tx=0).stop 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.795+0000 7f9888879640 1 -- 172.21.15.143:0/1574114949 reap_dead start 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.795+0000 7f988a2dc640 1 -- 172.21.15.143:0/1574114949 shutdown_connections 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.795+0000 7f988a2dc640 1 -- 172.21.15.143:0/1574114949 >> 172.21.15.143:0/1574114949 conn(0x7f98840740e0 msgr2=0x7f988406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.795+0000 7f988a2dc640 1 -- 172.21.15.143:0/1574114949 shutdown_connections 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.795+0000 7f988a2dc640 1 -- 172.21.15.143:0/1574114949 wait complete. 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.796+0000 7f988a2dc640 1 Processor -- start 2024-05-08T10:23:42.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.796+0000 7f988a2dc640 1 -- start start 2024-05-08T10:23:42.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f988a2dc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c003a00 0x7f98841f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f988a2dc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840b5b70 0x7f98840b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f988a2dc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9884161e90 0x7f9884162310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f988a2dc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f98840d4270 con 0x7f9884161e90 2024-05-08T10:23:42.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f988a2dc640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f98840d3f90 con 0x7f986c003a00 2024-05-08T10:23:42.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f988a2dc640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f98840b9720 con 0x7f98840b5b70 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9888879640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9884161e90 0x7f9884162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9888879640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9884161e90 0x7f9884162310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55852/0 (socket says 172.21.15.143:55852) 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9888879640 1 -- 172.21.15.143:0/3506172470 learned_addr learned my addr 172.21.15.143:0/3506172470 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f98837fe640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840b5b70 0x7f98840b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9888879640 1 -- 172.21.15.143:0/3506172470 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840b5b70 msgr2=0x7f98840b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9888879640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840b5b70 0x7f98840b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9888879640 1 -- 172.21.15.143:0/3506172470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c003a00 msgr2=0x7f98841f8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9888879640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c003a00 0x7f98841f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9888879640 1 -- 172.21.15.143:0/3506172470 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98840ad000 con 0x7f9884161e90 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9888879640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9884161e90 0x7f9884162310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9884163140 tx=0x7f987c00af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9880ff9640 1 -- 172.21.15.143:0/3506172470 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c007800 con 0x7f9884161e90 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9880ff9640 1 -- 172.21.15.143:0/3506172470 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f987c019070 con 0x7f9884161e90 2024-05-08T10:23:42.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98840b6870 con 0x7f9884161e90 2024-05-08T10:23:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f9880ff9640 1 -- 172.21.15.143:0/3506172470 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c0133f0 con 0x7f9884161e90 2024-05-08T10:23:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.797+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98840b6df0 con 0x7f9884161e90 2024-05-08T10:23:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.798+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988406a550 con 0x7f9884161e90 2024-05-08T10:23:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.799+0000 7f9880ff9640 1 -- 172.21.15.143:0/3506172470 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f987c013590 con 0x7f9884161e90 2024-05-08T10:23:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.799+0000 7f9880ff9640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9870076240 0x7f9870078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.799+0000 7f9883fff640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9870076240 0x7f9870078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.799+0000 7f9880ff9640 1 -- 172.21.15.143:0/3506172470 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f987c0975a0 con 0x7f9884161e90 2024-05-08T10:23:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.800+0000 7f9883fff640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9870076240 0x7f9870078700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9874034000 tx=0x7f987402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:42.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:42.804+0000 7f9880ff9640 1 -- 172.21.15.143:0/3506172470 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f98840ad000 con 0x7f9884161e90 2024-05-08T10:23:43.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.021+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9884162f20 con 0x7f9884161e90 2024-05-08T10:23:43.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.021+0000 7f9880ff9640 1 -- 172.21.15.143:0/3506172470 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f98840d0070 con 0x7f9884161e90 2024-05-08T10:23:43.007 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:43.007 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-08T10:23:43.007 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 2 2024-05-08T10:23:43.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9870076240 msgr2=0x7f9870078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:43.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9870076240 0x7f9870078700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9874034000 tx=0x7f987402c000 comp rx=0 tx=0).stop 2024-05-08T10:23:43.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9884161e90 msgr2=0x7f9884162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:43.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9884161e90 0x7f9884162310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9884163140 tx=0x7f987c00af80 comp rx=0 tx=0).stop 2024-05-08T10:23:43.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 shutdown_connections 2024-05-08T10:23:43.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9870076240 0x7f9870078700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:43.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9884161e90 0x7f9884162310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:43.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840b5b70 0x7f98840b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:43.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 --2- 172.21.15.143:0/3506172470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c003a00 0x7f98841f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:43.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 >> 172.21.15.143:0/3506172470 conn(0x7f98840740e0 msgr2=0x7f98840ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:43.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 shutdown_connections 2024-05-08T10:23:43.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:43.023+0000 7f988a2dc640 1 -- 172.21.15.143:0/3506172470 wait complete. 2024-05-08T10:23:45.020 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:23:45.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.136+0000 7fd34c2cc640 1 Processor -- start 2024-05-08T10:23:45.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.136+0000 7fd34c2cc640 1 -- start start 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.137+0000 7fd34c2cc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3441493c0 0x7fd3440afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.137+0000 7fd34c2cc640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd3440705f0 0x7fd34406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.137+0000 7fd34c2cc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd34406d870 0x7fd34406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.137+0000 7fd34c2cc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd34406dce0 con 0x7fd34406d870 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.137+0000 7fd34c2cc640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fd34415fde0 con 0x7fd3440705f0 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.137+0000 7fd34c2cc640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd3440b0560 con 0x7fd3441493c0 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd34a869640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd34406d870 0x7fd34406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd34a869640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd34406d870 0x7fd34406ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58590/0 (socket says 172.21.15.143:58590) 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd34a869640 1 -- 172.21.15.143:0/3645244326 learned_addr learned my addr 172.21.15.143:0/3645244326 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:45.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd34a068640 1 --2- 172.21.15.143:0/3645244326 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3441493c0 0x7fd3440afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd349867640 1 --2- 172.21.15.143:0/3645244326 >> v2:172.21.15.163:3300/0 conn(0x7fd3440705f0 0x7fd34406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd34a869640 1 -- 172.21.15.143:0/3645244326 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3441493c0 msgr2=0x7fd3440afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd34a869640 1 --2- 172.21.15.143:0/3645244326 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3441493c0 0x7fd3440afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd34a869640 1 -- 172.21.15.143:0/3645244326 >> v2:172.21.15.163:3300/0 conn(0x7fd3440705f0 msgr2=0x7fd34406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd34a869640 1 --2- 172.21.15.143:0/3645244326 >> v2:172.21.15.163:3300/0 conn(0x7fd3440705f0 0x7fd34406d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.138+0000 7fd34a869640 1 -- 172.21.15.143:0/3645244326 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3440b0840 con 0x7fd34406d870 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34a869640 1 --2- 172.21.15.143:0/3645244326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd34406d870 0x7fd34406ea40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd3440681d0 tx=0x7fd33c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ff3f6a613fa6db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd349066640 1 -- 172.21.15.143:0/3645244326 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c036070 con 0x7fd34406d870 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd349066640 1 -- 172.21.15.143:0/3645244326 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33c031600 con 0x7fd34406d870 2024-05-08T10:23:45.125 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd349066640 1 -- 172.21.15.143:0/3645244326 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0319d0 con 0x7fd34406d870 2024-05-08T10:23:45.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34c2cc640 1 -- 172.21.15.143:0/3645244326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd34406d870 msgr2=0x7fd34406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/3645244326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd34406d870 0x7fd34406ea40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd3440681d0 tx=0x7fd33c02a610 comp rx=0 tx=0).stop 2024-05-08T10:23:45.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34c2cc640 1 -- 172.21.15.143:0/3645244326 shutdown_connections 2024-05-08T10:23:45.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/3645244326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd34406d870 0x7fd34406ea40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/3645244326 >> v2:172.21.15.163:3300/0 conn(0x7fd3440705f0 0x7fd34406d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/3645244326 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd3441493c0 0x7fd3440afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34c2cc640 1 -- 172.21.15.143:0/3645244326 >> 172.21.15.143:0/3645244326 conn(0x7fd344072ba0 msgr2=0x7fd344072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34c2cc640 1 -- 172.21.15.143:0/3645244326 shutdown_connections 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.139+0000 7fd34c2cc640 1 -- 172.21.15.143:0/3645244326 wait complete. 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd34c2cc640 1 Processor -- start 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd34c2cc640 1 -- start start 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd34c2cc640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd34406d870 0x7fd3441592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd34c2cc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3440705f0 0x7fd3440b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd34c2cc640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3441493c0 0x7fd3440b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd34c2cc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440b0170 con 0x7fd3440705f0 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd34c2cc640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440b0e00 con 0x7fd3441493c0 2024-05-08T10:23:45.130 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd34c2cc640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd3440b02f0 con 0x7fd34406d870 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd349867640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3440705f0 0x7fd3440b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd349867640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3440705f0 0x7fd3440b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58602/0 (socket says 172.21.15.143:58602) 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.141+0000 7fd349867640 1 -- 172.21.15.143:0/247364774 learned_addr learned my addr 172.21.15.143:0/247364774 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd34a068640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd34406d870 0x7fd3441592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd34a869640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3441493c0 0x7fd3440b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd349867640 1 -- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd34406d870 msgr2=0x7fd3441592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd349867640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd34406d870 0x7fd3441592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd349867640 1 -- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3441493c0 msgr2=0x7fd3440b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd349867640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3441493c0 0x7fd3440b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd349867640 1 -- 172.21.15.143:0/247364774 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd344159c30 con 0x7fd3440705f0 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd34a068640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd34406d870 0x7fd3441592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd34a869640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3441493c0 0x7fd3440b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd349867640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3440705f0 0x7fd3440b1df0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd33800e870 tx=0x7fd33800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:45.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd336ffd640 1 -- 172.21.15.143:0/247364774 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338017070 con 0x7fd3440705f0 2024-05-08T10:23:45.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd336ffd640 1 -- 172.21.15.143:0/247364774 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33800c940 con 0x7fd3440705f0 2024-05-08T10:23:45.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd344159f10 con 0x7fd3440705f0 2024-05-08T10:23:45.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd336ffd640 1 -- 172.21.15.143:0/247364774 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33800cd30 con 0x7fd3440705f0 2024-05-08T10:23:45.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.142+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34415a4d0 con 0x7fd3440705f0 2024-05-08T10:23:45.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.143+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34406a550 con 0x7fd3440705f0 2024-05-08T10:23:45.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.144+0000 7fd336ffd640 1 -- 172.21.15.143:0/247364774 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fd33801a070 con 0x7fd3440705f0 2024-05-08T10:23:45.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.144+0000 7fd336ffd640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd328076240 0x7fd328078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.144+0000 7fd336ffd640 1 -- 172.21.15.143:0/247364774 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4857+0+0 (secure 0 0 0) 0x7fd338097360 con 0x7fd3440705f0 2024-05-08T10:23:45.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.144+0000 7fd34a068640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd328076240 0x7fd328078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.145+0000 7fd34a068640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd328076240 0x7fd328078700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd340009b10 tx=0x7fd340008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:45.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.149+0000 7fd336ffd640 1 -- 172.21.15.143:0/247364774 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd338061180 con 0x7fd3440705f0 2024-05-08T10:23:45.353 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.368+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3440d12c0 con 0x7fd3440705f0 2024-05-08T10:23:45.354 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.369+0000 7fd336ffd640 1 -- 172.21.15.143:0/247364774 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3876 (secure 0 0 0) 0x7fd338060a80 con 0x7fd3440705f0 2024-05-08T10:23:45.354 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:45.355 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/3021671777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3021671777},{"type":"v1","addr":"172.21.15.163:6834","nonce":3021671777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2147988445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":2147988445},{"type":"v1","addr":"172.21.15.163:6835","nonce":2147988445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/4179295945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":4179295945},{"type":"v1","addr":"172.21.15.143:6836","nonce":4179295945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-08T10:23:45.355 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 3 2024-05-08T10:23:45.356 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd328076240 msgr2=0x7fd328078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd328076240 0x7fd328078700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd340009b10 tx=0x7fd340008040 comp rx=0 tx=0).stop 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3440705f0 msgr2=0x7fd3440b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3440705f0 0x7fd3440b1df0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd33800e870 tx=0x7fd33800ed30 comp rx=0 tx=0).stop 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 shutdown_connections 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3441493c0 0x7fd3440b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd328076240 0x7fd328078700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3440705f0 0x7fd3440b1df0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 --2- 172.21.15.143:0/247364774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd34406d870 0x7fd3441592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 >> 172.21.15.143:0/247364774 conn(0x7fd344072ba0 msgr2=0x7fd344161f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 shutdown_connections 2024-05-08T10:23:45.357 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.371+0000 7fd34c2cc640 1 -- 172.21.15.143:0/247364774 wait complete. 2024-05-08T10:23:45.367 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T10:23:45.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.483+0000 7f85bc0a7640 1 Processor -- start 2024-05-08T10:23:45.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.484+0000 7f85bc0a7640 1 -- start start 2024-05-08T10:23:45.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85bc0a7640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f85b4159a30 0x7f85b40b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85bc0a7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f85b4159e10 0x7f85b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85bc0a7640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b415ffc0 con 0x7f85b406d870 2024-05-08T10:23:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85bc0a7640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f85b41602a0 con 0x7f85b4159e10 2024-05-08T10:23:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85bc0a7640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f85b4160580 con 0x7f85b4159a30 2024-05-08T10:23:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85b9642640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f85b4159e10 0x7f85b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85b9642640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f85b4159e10 0x7f85b406d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58604/0 (socket says 172.21.15.143:58604) 2024-05-08T10:23:45.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85b9642640 1 -- 172.21.15.143:0/215067260 learned_addr learned my addr 172.21.15.143:0/215067260 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:45.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85b9e43640 1 --2- 172.21.15.143:0/215067260 >> v2:172.21.15.163:3300/0 conn(0x7f85b4159a30 0x7f85b40b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85b9642640 1 -- 172.21.15.143:0/215067260 >> v2:172.21.15.163:3300/0 conn(0x7f85b4159a30 msgr2=0x7f85b40b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:45.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85b9642640 1 --2- 172.21.15.143:0/215067260 >> v2:172.21.15.163:3300/0 conn(0x7f85b4159a30 0x7f85b40b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85b9642640 1 -- 172.21.15.143:0/215067260 >> v1:172.21.15.163:6789/0 conn(0x7f85b406d870 legacy=0x7f85b41631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.485+0000 7f85b9642640 1 -- 172.21.15.143:0/215067260 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b4160860 con 0x7f85b4159e10 2024-05-08T10:23:45.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85b9642640 1 --2- 172.21.15.143:0/215067260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b4159e10 0x7f85b406d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85b406e810 tx=0x7f85a802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2aa3ff8c3f6b407 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:45.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85b8e41640 1 -- 172.21.15.143:0/215067260 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8037070 con 0x7f85b4159e10 2024-05-08T10:23:45.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85b8e41640 1 -- 172.21.15.143:0/215067260 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a8032440 con 0x7f85b4159e10 2024-05-08T10:23:45.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85b8e41640 1 -- 172.21.15.143:0/215067260 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8032810 con 0x7f85b4159e10 2024-05-08T10:23:45.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85bc0a7640 1 -- 172.21.15.143:0/215067260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b4159e10 msgr2=0x7f85b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85bc0a7640 1 --2- 172.21.15.143:0/215067260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b4159e10 0x7f85b406d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85b406e810 tx=0x7f85a802a150 comp rx=0 tx=0).stop 2024-05-08T10:23:45.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85bc0a7640 1 -- 172.21.15.143:0/215067260 shutdown_connections 2024-05-08T10:23:45.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85bc0a7640 1 --2- 172.21.15.143:0/215067260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b4159e10 0x7f85b406d330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85bc0a7640 1 --2- 172.21.15.143:0/215067260 >> v2:172.21.15.163:3300/0 conn(0x7f85b4159a30 0x7f85b40b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.486+0000 7f85bc0a7640 1 -- 172.21.15.143:0/215067260 >> 172.21.15.143:0/215067260 conn(0x7f85b4072bd0 msgr2=0x7f85b4072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:45.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.487+0000 7f85bc0a7640 1 -- 172.21.15.143:0/215067260 shutdown_connections 2024-05-08T10:23:45.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.487+0000 7f85bc0a7640 1 -- 172.21.15.143:0/215067260 wait complete. 2024-05-08T10:23:45.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85bc0a7640 1 Processor -- start 2024-05-08T10:23:45.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85bc0a7640 1 -- start start 2024-05-08T10:23:45.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85bc0a7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b406d870 0x7f85b4146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85bc0a7640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85b4159a30 0x7f85b41473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85bc0a7640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b4159e10 0x7f85b41f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85bc0a7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f85b40b5020 con 0x7f85b406d870 2024-05-08T10:23:45.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85bc0a7640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f85b40b4ea0 con 0x7f85b4159a30 2024-05-08T10:23:45.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85bc0a7640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f85b40afc00 con 0x7f85b4159e10 2024-05-08T10:23:45.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85b9e43640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b406d870 0x7f85b4146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85b9e43640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b406d870 0x7f85b4146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58612/0 (socket says 172.21.15.143:58612) 2024-05-08T10:23:45.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.488+0000 7f85b9e43640 1 -- 172.21.15.143:0/1567340439 learned_addr learned my addr 172.21.15.143:0/1567340439 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:45.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b9642640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85b4159a30 0x7f85b41473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85ba644640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b4159e10 0x7f85b41f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b9e43640 1 -- 172.21.15.143:0/1567340439 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b4159e10 msgr2=0x7f85b41f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b9e43640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b4159e10 0x7f85b41f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b9e43640 1 -- 172.21.15.143:0/1567340439 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85b4159a30 msgr2=0x7f85b41473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b9e43640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85b4159a30 0x7f85b41473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b9e43640 1 -- 172.21.15.143:0/1567340439 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b41f94e0 con 0x7f85b406d870 2024-05-08T10:23:45.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85ba644640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b4159e10 0x7f85b41f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:45.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b9e43640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b406d870 0x7f85b4146da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00e9b0 tx=0x7f85ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:45.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b27fc640 1 -- 172.21.15.143:0/1567340439 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac017070 con 0x7f85b406d870 2024-05-08T10:23:45.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b27fc640 1 -- 172.21.15.143:0/1567340439 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ac00c9a0 con 0x7f85b406d870 2024-05-08T10:23:45.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b415a9d0 con 0x7f85b406d870 2024-05-08T10:23:45.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85b27fc640 1 -- 172.21.15.143:0/1567340439 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac00cd90 con 0x7f85b406d870 2024-05-08T10:23:45.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.489+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b4162150 con 0x7f85b406d870 2024-05-08T10:23:45.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.490+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b4068920 con 0x7f85b406d870 2024-05-08T10:23:45.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.491+0000 7f85b27fc640 1 -- 172.21.15.143:0/1567340439 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f85ac01a070 con 0x7f85b406d870 2024-05-08T10:23:45.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.491+0000 7f85b27fc640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f85a00762d0 0x7f85a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.491+0000 7f85b9642640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f85a00762d0 0x7f85a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.491+0000 7f85b27fc640 1 -- 172.21.15.143:0/1567340439 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f85ac097530 con 0x7f85b406d870 2024-05-08T10:23:45.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.492+0000 7f85b9642640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f85a00762d0 0x7f85a0078790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f85a8034000 tx=0x7f85a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:45.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.496+0000 7f85b27fc640 1 -- 172.21.15.143:0/1567340439 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f85ac060c20 con 0x7f85b406d870 2024-05-08T10:23:45.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.679+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f85b406a4b0 con 0x7f85b406d870 2024-05-08T10:23:45.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.679+0000 7f85b27fc640 1 -- 172.21.15.143:0/1567340439 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f85ac064f20 con 0x7f85b406d870 2024-05-08T10:23:45.667 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:45.668 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2024-05-08T10:23:45.668 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:23:45.668 INFO:teuthology.orchestra.run.smithi143.stdout: "poolnum": 1, 2024-05-08T10:23:45.668 INFO:teuthology.orchestra.run.smithi143.stdout: "poolname": ".mgr" 2024-05-08T10:23:45.668 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:23:45.668 INFO:teuthology.orchestra.run.smithi143.stdout:] 2024-05-08T10:23:45.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f85a00762d0 msgr2=0x7f85a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f85a00762d0 0x7f85a0078790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f85a8034000 tx=0x7f85a802e000 comp rx=0 tx=0).stop 2024-05-08T10:23:45.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b406d870 msgr2=0x7f85b4146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b406d870 0x7f85b4146da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00e9b0 tx=0x7f85ac00ee70 comp rx=0 tx=0).stop 2024-05-08T10:23:45.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 shutdown_connections 2024-05-08T10:23:45.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b4159e10 0x7f85b41f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85b4159a30 0x7f85b41473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f85a00762d0 0x7f85a0078790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 --2- 172.21.15.143:0/1567340439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85b406d870 0x7f85b4146da0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 >> 172.21.15.143:0/1567340439 conn(0x7f85b4072bd0 msgr2=0x7f85b40b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:45.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 shutdown_connections 2024-05-08T10:23:45.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.681+0000 7f85bc0a7640 1 -- 172.21.15.143:0/1567340439 wait complete. 2024-05-08T10:23:45.677 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T10:23:45.677 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T10:23:45.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.795+0000 7fbd930a7640 1 Processor -- start 2024-05-08T10:23:45.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.795+0000 7fbd930a7640 1 -- start start 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd930a7640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c0d3b60 0x7fbd8c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd930a7640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c071eb0 con 0x7fbd8c0cf5a0 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd930a7640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c071940 con 0x7fbd8c070e50 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd930a7640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c070aa0 con 0x7fbd8c0d3b60 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd91644640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fbd8c0cf5a0 0x7fbd8c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54224/0 (socket says 172.21.15.143:54224) 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd91644640 1 -- 172.21.15.143:0/1721297581 learned_addr learned my addr 172.21.15.143:0/1721297581 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689209323 0 0) 0x7fbd84001110 con 0x7fbd8c0cf5a0 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd74003520 con 0x7fbd8c0cf5a0 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd83fff640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c0d3b60 0x7fbd8c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3754210871 0 0) 0x7fbd74003520 con 0x7fbd8c0cf5a0 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c0d3b60 msgr2=0x7fbd8c06ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:45.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c0d3b60 0x7fbd8c06ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 >> v1:172.21.15.163:6789/0 conn(0x7fbd8c070e50 legacy=0x7fbd8c071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c071bd0 con 0x7fbd8c0cf5a0 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7fbd840018c0 con 0x7fbd8c0cf5a0 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 >> v1:172.21.15.143:6789/0 conn(0x7fbd8c0cf5a0 legacy=0x7fbd8c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd74003a30 0x7fbd74003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c0d3b60 0x7fbd74005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c070aa0 con 0x7fbd74004800 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7400baf0 con 0x7fbd74003a30 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbd7400bcf0 con 0x7fbd8c0d3b60 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.796+0000 7fbd83fff640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.797+0000 7fbd90e43640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd74003a30 0x7fbd74003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.797+0000 7fbd91644640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c0d3b60 0x7fbd74005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.797+0000 7fbd83fff640 1 -- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c0d3b60 msgr2=0x7fbd74005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.797+0000 7fbd83fff640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c0d3b60 0x7fbd74005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.797+0000 7fbd83fff640 1 -- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd74003a30 msgr2=0x7fbd74003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.797+0000 7fbd83fff640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd74003a30 0x7fbd74003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.797+0000 7fbd83fff640 1 -- 172.21.15.143:0/1721297581 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd74003520 con 0x7fbd74004800 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.797+0000 7fbd83fff640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd74004c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009ac0 tx=0x7fbd74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a692742397c674d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c036070 con 0x7fbd74004800 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c031400 con 0x7fbd74004800 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd837fe640 1 -- 172.21.15.143:0/1721297581 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c009690 con 0x7fbd74004800 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd930a7640 1 -- 172.21.15.143:0/1721297581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 msgr2=0x7fbd74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd930a7640 1 --2- 172.21.15.143:0/1721297581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd74004c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009ac0 tx=0x7fbd74005830 comp rx=0 tx=0).stop 2024-05-08T10:23:45.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd91644640 1 -- 172.21.15.143:0/1721297581 reap_dead start 2024-05-08T10:23:45.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd930a7640 1 -- 172.21.15.143:0/1721297581 shutdown_connections 2024-05-08T10:23:45.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd930a7640 1 -- 172.21.15.143:0/1721297581 >> 172.21.15.143:0/1721297581 conn(0x7fbd8c0d3040 msgr2=0x7fbd8c0d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:45.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd930a7640 1 -- 172.21.15.143:0/1721297581 shutdown_connections 2024-05-08T10:23:45.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.798+0000 7fbd930a7640 1 -- 172.21.15.143:0/1721297581 wait complete. 2024-05-08T10:23:45.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.799+0000 7fbd930a7640 1 Processor -- start 2024-05-08T10:23:45.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.799+0000 7fbd930a7640 1 -- start start 2024-05-08T10:23:45.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd930a7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd8c09d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd930a7640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c1f88b0 0x7fbd8c09e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd930a7640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd8c0b0c90 0x7fbd8c0b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd930a7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c15f9d0 con 0x7fbd74004800 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd930a7640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0b8200 con 0x7fbd8c0b0c90 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd930a7640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c09cb00 con 0x7fbd8c1f88b0 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd90e43640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd8c09d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd90e43640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd8c09d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58622/0 (socket says 172.21.15.143:58622) 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd90e43640 1 -- 172.21.15.143:0/4189647122 learned_addr learned my addr 172.21.15.143:0/4189647122 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd91644640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd8c0b0c90 0x7fbd8c0b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd83fff640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c1f88b0 0x7fbd8c09e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd90e43640 1 -- 172.21.15.143:0/4189647122 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c1f88b0 msgr2=0x7fbd8c09e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd90e43640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c1f88b0 0x7fbd8c09e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd90e43640 1 -- 172.21.15.143:0/4189647122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd8c0b0c90 msgr2=0x7fbd8c0b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd90e43640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd8c0b0c90 0x7fbd8c0b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.800+0000 7fbd90e43640 1 -- 172.21.15.143:0/4189647122 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c09e5b0 con 0x7fbd74004800 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.801+0000 7fbd90e43640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd8c09d040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800fb90 tx=0x7fbd8800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.801+0000 7fbd817fa640 1 -- 172.21.15.143:0/4189647122 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8800fe90 con 0x7fbd74004800 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.801+0000 7fbd817fa640 1 -- 172.21.15.143:0/4189647122 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd88018070 con 0x7fbd74004800 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.801+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c1f8d70 con 0x7fbd74004800 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.801+0000 7fbd817fa640 1 -- 172.21.15.143:0/4189647122 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8800de70 con 0x7fbd74004800 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.801+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c1f9330 con 0x7fbd74004800 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.802+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd8c06a550 con 0x7fbd74004800 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.802+0000 7fbd817fa640 1 -- 172.21.15.143:0/4189647122 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd88003970 con 0x7fbd74004800 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.803+0000 7fbd817fa640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbd780764a0 0x7fbd78078960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.803+0000 7fbd83fff640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbd780764a0 0x7fbd78078960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.803+0000 7fbd817fa640 1 -- 172.21.15.143:0/4189647122 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fbd88097490 con 0x7fbd74004800 2024-05-08T10:23:45.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.803+0000 7fbd83fff640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbd780764a0 0x7fbd78078960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c033000 tx=0x7fbd7c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:45.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.807+0000 7fbd817fa640 1 -- 172.21.15.143:0/4189647122 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbd88061140 con 0x7fbd74004800 2024-05-08T10:23:45.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:45.988+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbd8c06f220 con 0x7fbd74004800 2024-05-08T10:23:46.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.413+0000 7fbd817fa640 1 -- 172.21.15.143:0/4189647122 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fbd88069130 con 0x7fbd74004800 2024-05-08T10:23:46.399 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' created 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbd780764a0 msgr2=0x7fbd78078960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbd780764a0 0x7fbd78078960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c033000 tx=0x7fbd7c008030 comp rx=0 tx=0).stop 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 msgr2=0x7fbd8c09d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd8c09d040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800fb90 tx=0x7fbd8800d520 comp rx=0 tx=0).stop 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 shutdown_connections 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd8c0b0c90 0x7fbd8c0b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd8c1f88b0 0x7fbd8c09e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbd780764a0 0x7fbd78078960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 --2- 172.21.15.143:0/4189647122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd74004800 0x7fbd8c09d040 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.417+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 >> 172.21.15.143:0/4189647122 conn(0x7fbd8c0d3040 msgr2=0x7fbd8c0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.418+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 shutdown_connections 2024-05-08T10:23:46.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.418+0000 7fbd930a7640 1 -- 172.21.15.143:0/4189647122 wait complete. 2024-05-08T10:23:46.417 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T10:23:46.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.541+0000 7fbf7b893640 1 Processor -- start 2024-05-08T10:23:46.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.541+0000 7fbf7b893640 1 -- start start 2024-05-08T10:23:46.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf7b893640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbf74148e20 0x7fbf7406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:46.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf7b893640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbf74162ea0 0x7fbf740b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf7b893640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7406de40 con 0x7fbf740b6910 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf7b893640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbf740b6d80 con 0x7fbf74162ea0 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf7b893640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fbf7406e0e0 con 0x7fbf74148e20 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf78e2e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbf74162ea0 0x7fbf740b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf78e2e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbf74162ea0 0x7fbf740b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58632/0 (socket says 172.21.15.143:58632) 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf78e2e640 1 -- 172.21.15.143:0/2490134437 learned_addr learned my addr 172.21.15.143:0/2490134437 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf7962f640 1 --2- 172.21.15.143:0/2490134437 >> v2:172.21.15.163:3300/0 conn(0x7fbf74148e20 0x7fbf7406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf78e2e640 1 -- 172.21.15.143:0/2490134437 >> v2:172.21.15.163:3300/0 conn(0x7fbf74148e20 msgr2=0x7fbf7406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf78e2e640 1 --2- 172.21.15.143:0/2490134437 >> v2:172.21.15.163:3300/0 conn(0x7fbf74148e20 0x7fbf7406d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf78e2e640 1 -- 172.21.15.143:0/2490134437 >> v1:172.21.15.163:6789/0 conn(0x7fbf740b6910 legacy=0x7fbf74071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.542+0000 7fbf78e2e640 1 -- 172.21.15.143:0/2490134437 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7406e3c0 con 0x7fbf74162ea0 2024-05-08T10:23:46.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf78e2e640 1 --2- 172.21.15.143:0/2490134437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf74162ea0 0x7fbf740b63d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf74064080 tx=0x7fbf6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720348c723329bb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf6bfff640 1 -- 172.21.15.143:0/2490134437 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64037070 con 0x7fbf74162ea0 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf6bfff640 1 -- 172.21.15.143:0/2490134437 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf64032440 con 0x7fbf74162ea0 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf6bfff640 1 -- 172.21.15.143:0/2490134437 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64032810 con 0x7fbf74162ea0 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf7b893640 1 -- 172.21.15.143:0/2490134437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf74162ea0 msgr2=0x7fbf740b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf7b893640 1 --2- 172.21.15.143:0/2490134437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf74162ea0 0x7fbf740b63d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf74064080 tx=0x7fbf6402a1e0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf7b893640 1 -- 172.21.15.143:0/2490134437 shutdown_connections 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf7b893640 1 --2- 172.21.15.143:0/2490134437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf74162ea0 0x7fbf740b63d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf7b893640 1 --2- 172.21.15.143:0/2490134437 >> v2:172.21.15.163:3300/0 conn(0x7fbf74148e20 0x7fbf7406d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.543+0000 7fbf7b893640 1 -- 172.21.15.143:0/2490134437 >> 172.21.15.143:0/2490134437 conn(0x7fbf740706c0 msgr2=0x7fbf74070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.544+0000 7fbf7b893640 1 -- 172.21.15.143:0/2490134437 shutdown_connections 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.544+0000 7fbf7b893640 1 -- 172.21.15.143:0/2490134437 wait complete. 2024-05-08T10:23:46.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7b893640 1 Processor -- start 2024-05-08T10:23:46.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7b893640 1 -- start start 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7b893640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf740b6910 0x7fbf741f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7b893640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf74148e20 0x7fbf7415ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7b893640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf74162ea0 0x7fbf741470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7b893640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74160cc0 con 0x7fbf740b6910 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7b893640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7406e980 con 0x7fbf74162ea0 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7b893640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbf74160e40 con 0x7fbf74148e20 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7962f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf740b6910 0x7fbf741f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7962f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf740b6910 0x7fbf741f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58638/0 (socket says 172.21.15.143:58638) 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.545+0000 7fbf7962f640 1 -- 172.21.15.143:0/1545893740 learned_addr learned my addr 172.21.15.143:0/1545893740 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf79e30640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf74162ea0 0x7fbf741470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:46.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf78e2e640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf74148e20 0x7fbf7415ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf7962f640 1 -- 172.21.15.143:0/1545893740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf74148e20 msgr2=0x7fbf7415ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf7962f640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf74148e20 0x7fbf7415ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf7962f640 1 -- 172.21.15.143:0/1545893740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf74162ea0 msgr2=0x7fbf741470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf7962f640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf74162ea0 0x7fbf741470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf7962f640 1 -- 172.21.15.143:0/1545893740 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf74147b00 con 0x7fbf740b6910 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf7962f640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf740b6910 0x7fbf741f5390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00d800 tx=0x7fbf6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf69ffb640 1 -- 172.21.15.143:0/1545893740 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c00b6c0 con 0x7fbf740b6910 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf69ffb640 1 -- 172.21.15.143:0/1545893740 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6c019070 con 0x7fbf740b6910 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf74144f50 con 0x7fbf740b6910 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf69ffb640 1 -- 172.21.15.143:0/1545893740 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c00ba80 con 0x7fbf740b6910 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.546+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf74145510 con 0x7fbf740b6910 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.547+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7406a550 con 0x7fbf740b6910 2024-05-08T10:23:46.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.548+0000 7fbf69ffb640 1 -- 172.21.15.143:0/1545893740 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf6c00bc20 con 0x7fbf740b6910 2024-05-08T10:23:46.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.548+0000 7fbf69ffb640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbf580762d0 0x7fbf58078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:46.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.549+0000 7fbf78e2e640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbf580762d0 0x7fbf58078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:46.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.549+0000 7fbf69ffb640 1 -- 172.21.15.143:0/1545893740 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fbf6c097990 con 0x7fbf740b6910 2024-05-08T10:23:46.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.549+0000 7fbf78e2e640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbf580762d0 0x7fbf58078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf64034000 tx=0x7fbf6402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:46.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.553+0000 7fbf69ffb640 1 -- 172.21.15.143:0/1545893740 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbf6c061430 con 0x7fbf740b6910 2024-05-08T10:23:46.718 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:46.733+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbf740d3d60 con 0x7fbf740b6910 2024-05-08T10:23:47.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.417+0000 7fbf69ffb640 1 -- 172.21.15.143:0/1545893740 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fbf6c060d30 con 0x7fbf740b6910 2024-05-08T10:23:47.404 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' created 2024-05-08T10:23:47.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.422+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbf580762d0 msgr2=0x7fbf58078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:47.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.422+0000 7fbf7b893640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbf580762d0 0x7fbf58078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf64034000 tx=0x7fbf6402e000 comp rx=0 tx=0).stop 2024-05-08T10:23:47.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.422+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf740b6910 msgr2=0x7fbf741f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:47.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.422+0000 7fbf7b893640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf740b6910 0x7fbf741f5390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00d800 tx=0x7fbf6c00dcc0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.423+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 shutdown_connections 2024-05-08T10:23:47.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.423+0000 7fbf7b893640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf74162ea0 0x7fbf741470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.423+0000 7fbf7b893640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf74148e20 0x7fbf7415ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.423+0000 7fbf7b893640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbf580762d0 0x7fbf58078790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.423+0000 7fbf7b893640 1 --2- 172.21.15.143:0/1545893740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf740b6910 0x7fbf741f5390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.423+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 >> 172.21.15.143:0/1545893740 conn(0x7fbf740706c0 msgr2=0x7fbf74162090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:47.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.423+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 shutdown_connections 2024-05-08T10:23:47.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.424+0000 7fbf7b893640 1 -- 172.21.15.143:0/1545893740 wait complete. 2024-05-08T10:23:47.432 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T10:23:47.536 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.550+0000 7f8f47f2b640 1 Processor -- start 2024-05-08T10:23:47.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.550+0000 7f8f47f2b640 1 -- start start 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.551+0000 7f8f47f2b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f4015f600 0x7f8f400d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.551+0000 7f8f47f2b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8f400d0e20 0x7f8f400d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.551+0000 7f8f47f2b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f400d2830 con 0x7f8f400d5a10 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.551+0000 7f8f47f2b640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f8f400d3070 con 0x7f8f400d0e20 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.551+0000 7f8f47f2b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8f400d3350 con 0x7f8f4015f600 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.551+0000 7f8f454c6640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8f400d5a10 0x7f8f400b1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54228/0 (socket says 172.21.15.143:54228) 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.551+0000 7f8f454c6640 1 -- 172.21.15.143:0/1895220624 learned_addr learned my addr 172.21.15.143:0/1895220624 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102328668 0 0) 0x7f8f400d2830 con 0x7f8f400d5a10 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f2c003520 con 0x7f8f400d5a10 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f45cc7640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f4015f600 0x7f8f400d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f464c8640 1 --2- 172.21.15.143:0/1895220624 >> v2:172.21.15.163:3300/0 conn(0x7f8f400d0e20 0x7f8f400d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2705188749 0 0) 0x7f8f2c003520 con 0x7f8f400d5a10 2024-05-08T10:23:47.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f4015f600 msgr2=0x7f8f400d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f4015f600 0x7f8f400d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 >> v2:172.21.15.163:3300/0 conn(0x7f8f400d0e20 msgr2=0x7f8f400d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 --2- 172.21.15.143:0/1895220624 >> v2:172.21.15.163:3300/0 conn(0x7f8f400d0e20 0x7f8f400d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f400d3630 con 0x7f8f400d5a10 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f8f300016f0 con 0x7f8f400d5a10 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 >> v1:172.21.15.143:6789/0 conn(0x7f8f400d5a10 legacy=0x7f8f400b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f4015f600 0x7f8f2c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f2c003fd0 0x7f8f2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f2c004d40 0x7f8f2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:47.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400d3070 con 0x7f8f2c004d40 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400d3350 con 0x7f8f2c003fd0 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c00baa0 con 0x7f8f4015f600 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f464c8640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f2c004d40 0x7f8f2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f45cc7640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f4015f600 0x7f8f2c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f454c6640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f2c003fd0 0x7f8f2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f464c8640 1 -- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f4015f600 msgr2=0x7f8f2c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f464c8640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f4015f600 0x7f8f2c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f464c8640 1 -- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f2c003fd0 msgr2=0x7f8f2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f464c8640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f2c003fd0 0x7f8f2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.552+0000 7f8f464c8640 1 -- 172.21.15.143:0/1895220624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c003520 con 0x7f8f2c004d40 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.553+0000 7f8f464c8640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f2c004d40 0x7f8f2c0051c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009ac0 tx=0x7f8f2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccba601e8d257f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.553+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38036070 con 0x7f8f2c004d40 2024-05-08T10:23:47.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.553+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f38031400 con 0x7f8f2c004d40 2024-05-08T10:23:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.553+0000 7f8f44cc5640 1 -- 172.21.15.143:0/1895220624 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38009690 con 0x7f8f2c004d40 2024-05-08T10:23:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.554+0000 7f8f47f2b640 1 -- 172.21.15.143:0/1895220624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f2c004d40 msgr2=0x7f8f2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.554+0000 7f8f47f2b640 1 --2- 172.21.15.143:0/1895220624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f2c004d40 0x7f8f2c0051c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009ac0 tx=0x7f8f2c005830 comp rx=0 tx=0).stop 2024-05-08T10:23:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.554+0000 7f8f464c8640 1 -- 172.21.15.143:0/1895220624 reap_dead start 2024-05-08T10:23:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.554+0000 7f8f47f2b640 1 -- 172.21.15.143:0/1895220624 shutdown_connections 2024-05-08T10:23:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.554+0000 7f8f47f2b640 1 -- 172.21.15.143:0/1895220624 >> 172.21.15.143:0/1895220624 conn(0x7f8f4009e5b0 msgr2=0x7f8f400d5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.554+0000 7f8f47f2b640 1 -- 172.21.15.143:0/1895220624 shutdown_connections 2024-05-08T10:23:47.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.554+0000 7f8f47f2b640 1 -- 172.21.15.143:0/1895220624 wait complete. 2024-05-08T10:23:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.555+0000 7f8f47f2b640 1 Processor -- start 2024-05-08T10:23:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.555+0000 7f8f47f2b640 1 -- start start 2024-05-08T10:23:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f47f2b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2c004d40 0x7f8f4015d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f47f2b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f400cd1a0 0x7f8f400ba750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f47f2b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f400cd600 0x7f8f40161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f47f2b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400d4160 con 0x7f8f400cd600 2024-05-08T10:23:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f47f2b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400d3c40 con 0x7f8f400cd1a0 2024-05-08T10:23:47.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f47f2b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4015f9e0 con 0x7f8f2c004d40 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f464c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f400cd600 0x7f8f40161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f464c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f400cd600 0x7f8f40161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58648/0 (socket says 172.21.15.143:58648) 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f464c8640 1 -- 172.21.15.143:0/4115724097 learned_addr learned my addr 172.21.15.143:0/4115724097 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f45cc7640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2c004d40 0x7f8f4015d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f454c6640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f400cd1a0 0x7f8f400ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f464c8640 1 -- 172.21.15.143:0/4115724097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2c004d40 msgr2=0x7f8f4015d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f464c8640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2c004d40 0x7f8f4015d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f464c8640 1 -- 172.21.15.143:0/4115724097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f400cd1a0 msgr2=0x7f8f400ba750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f464c8640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f400cd1a0 0x7f8f400ba750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f464c8640 1 -- 172.21.15.143:0/4115724097 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f400cdfe0 con 0x7f8f400cd600 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f454c6640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f400cd1a0 0x7f8f400ba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f464c8640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f400cd600 0x7f8f40161eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009be0 tx=0x7f8f38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:47.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f367fc640 1 -- 172.21.15.143:0/4115724097 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38036040 con 0x7f8f400cd600 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f367fc640 1 -- 172.21.15.143:0/4115724097 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f38041070 con 0x7f8f400cd600 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f400b9990 con 0x7f8f400cd600 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.556+0000 7f8f367fc640 1 -- 172.21.15.143:0/4115724097 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38009690 con 0x7f8f400cd600 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.557+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f400b9f50 con 0x7f8f400cd600 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.557+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4006a550 con 0x7f8f400cd600 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.558+0000 7f8f367fc640 1 -- 172.21.15.143:0/4115724097 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8f38039070 con 0x7f8f400cd600 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.559+0000 7f8f367fc640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8f240762d0 0x7f8f24078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.559+0000 7f8f45cc7640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8f240762d0 0x7f8f24078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.559+0000 7f8f367fc640 1 -- 172.21.15.143:0/4115724097 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f8f380b6d20 con 0x7f8f400cd600 2024-05-08T10:23:47.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.559+0000 7f8f45cc7640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8f240762d0 0x7f8f24078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c014510 tx=0x7f8f3c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:47.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.563+0000 7f8f367fc640 1 -- 172.21.15.143:0/4115724097 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8f3804a020 con 0x7f8f400cd600 2024-05-08T10:23:47.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:47.782+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8f400b2600 con 0x7f8f400cd600 2024-05-08T10:23:48.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.419+0000 7f8f367fc640 1 -- 172.21.15.143:0/4115724097 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8f38080000 con 0x7f8f400cd600 2024-05-08T10:23:48.405 INFO:teuthology.orchestra.run.smithi143.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T10:23:48.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8f240762d0 msgr2=0x7f8f24078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8f240762d0 0x7f8f24078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c014510 tx=0x7f8f3c00b040 comp rx=0 tx=0).stop 2024-05-08T10:23:48.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f400cd600 msgr2=0x7f8f40161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f400cd600 0x7f8f40161eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009be0 tx=0x7f8f38004730 comp rx=0 tx=0).stop 2024-05-08T10:23:48.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 shutdown_connections 2024-05-08T10:23:48.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8f240762d0 0x7f8f24078790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f400cd600 0x7f8f40161eb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f400cd1a0 0x7f8f400ba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 --2- 172.21.15.143:0/4115724097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8f2c004d40 0x7f8f4015d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 >> 172.21.15.143:0/4115724097 conn(0x7f8f4009e5b0 msgr2=0x7f8f400b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:48.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 shutdown_connections 2024-05-08T10:23:48.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.422+0000 7f8f47f2b640 1 -- 172.21.15.143:0/4115724097 wait complete. 2024-05-08T10:23:48.433 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:23:48.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.549+0000 7f918d319640 1 Processor -- start 2024-05-08T10:23:48.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.549+0000 7f918d319640 1 -- start start 2024-05-08T10:23:48.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f918d319640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f918815f760 0x7f91880b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f918d319640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880cfc10 0x7f91880d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f918d319640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91880d0830 0x7f91880b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f918d319640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f918815fb40 con 0x7f91880d0830 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f918d319640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f91880d0070 con 0x7f918815f760 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f918d319640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f91880d36f0 con 0x7f91880cfc10 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f91877fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91880d0830 0x7f91880b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f91877fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91880d0830 0x7f91880b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58662/0 (socket says 172.21.15.143:58662) 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f91877fe640 1 -- 172.21.15.143:0/161780200 learned_addr learned my addr 172.21.15.143:0/161780200 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f91877fe640 1 -- 172.21.15.143:0/161780200 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880cfc10 msgr2=0x7f91880d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f91867fc640 1 --2- 172.21.15.143:0/161780200 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880cfc10 0x7f91880d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f91877fe640 1 --2- 172.21.15.143:0/161780200 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880cfc10 0x7f91880d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f91877fe640 1 -- 172.21.15.143:0/161780200 >> v2:172.21.15.163:3300/0 conn(0x7f918815f760 msgr2=0x7f91880b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:48.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f9186ffd640 1 --2- 172.21.15.143:0/161780200 >> v2:172.21.15.163:3300/0 conn(0x7f918815f760 0x7f91880b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f91877fe640 1 --2- 172.21.15.143:0/161780200 >> v2:172.21.15.163:3300/0 conn(0x7f918815f760 0x7f91880b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f91877fe640 1 -- 172.21.15.143:0/161780200 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91880d39d0 con 0x7f91880d0830 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.550+0000 7f9186ffd640 1 --2- 172.21.15.143:0/161780200 >> v2:172.21.15.163:3300/0 conn(0x7f918815f760 0x7f91880b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.551+0000 7f91877fe640 1 --2- 172.21.15.143:0/161780200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880d0830 0x7f91880b6d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91880d2860 tx=0x7f918002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a92997fd2ed4c52 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.551+0000 7f9185ffb640 1 -- 172.21.15.143:0/161780200 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180037070 con 0x7f91880d0830 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.551+0000 7f9185ffb640 1 -- 172.21.15.143:0/161780200 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9180032440 con 0x7f91880d0830 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.551+0000 7f9185ffb640 1 -- 172.21.15.143:0/161780200 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180032810 con 0x7f91880d0830 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.552+0000 7f918d319640 1 -- 172.21.15.143:0/161780200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880d0830 msgr2=0x7f91880b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.552+0000 7f918d319640 1 --2- 172.21.15.143:0/161780200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880d0830 0x7f91880b6d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91880d2860 tx=0x7f918002a140 comp rx=0 tx=0).stop 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.552+0000 7f918d319640 1 -- 172.21.15.143:0/161780200 shutdown_connections 2024-05-08T10:23:48.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.552+0000 7f918d319640 1 --2- 172.21.15.143:0/161780200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880d0830 0x7f91880b6d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.552+0000 7f918d319640 1 --2- 172.21.15.143:0/161780200 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880cfc10 0x7f91880d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.552+0000 7f918d319640 1 --2- 172.21.15.143:0/161780200 >> v2:172.21.15.163:3300/0 conn(0x7f918815f760 0x7f91880b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.552+0000 7f918d319640 1 -- 172.21.15.143:0/161780200 >> 172.21.15.143:0/161780200 conn(0x7f91880740e0 msgr2=0x7f918806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:48.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.552+0000 7f918d319640 1 -- 172.21.15.143:0/161780200 shutdown_connections 2024-05-08T10:23:48.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.552+0000 7f918d319640 1 -- 172.21.15.143:0/161780200 wait complete. 2024-05-08T10:23:48.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.553+0000 7f918d319640 1 Processor -- start 2024-05-08T10:23:48.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.553+0000 7f918d319640 1 -- start start 2024-05-08T10:23:48.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f918d319640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880cfc10 0x7f91881f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f918d319640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880d0830 0x7f918815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f918d319640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f918815f760 0x7f918815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f918d319640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f91880d4270 con 0x7f91880cfc10 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f918d319640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f91880d3f90 con 0x7f918815f760 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f918d319640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f91880d4790 con 0x7f91880d0830 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f9186ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880cfc10 0x7f91881f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f9186ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880cfc10 0x7f91881f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58674/0 (socket says 172.21.15.143:58674) 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f9186ffd640 1 -- 172.21.15.143:0/1314571348 learned_addr learned my addr 172.21.15.143:0/1314571348 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f91867fc640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880d0830 0x7f918815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f91877fe640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f918815f760 0x7f918815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f9186ffd640 1 -- 172.21.15.143:0/1314571348 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880d0830 msgr2=0x7f918815b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f9186ffd640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880d0830 0x7f918815b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f9186ffd640 1 -- 172.21.15.143:0/1314571348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f918815f760 msgr2=0x7f918815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f9186ffd640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f918815f760 0x7f918815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f9186ffd640 1 -- 172.21.15.143:0/1314571348 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91880b5b60 con 0x7f91880cfc10 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.554+0000 7f9186ffd640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880cfc10 0x7f91881f46d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f917800cf60 tx=0x7f917800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.555+0000 7f916f7fe640 1 -- 172.21.15.143:0/1314571348 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917801a070 con 0x7f91880cfc10 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.555+0000 7f916f7fe640 1 -- 172.21.15.143:0/1314571348 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917800d840 con 0x7f91880cfc10 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.555+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91880b5e40 con 0x7f91880cfc10 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.555+0000 7f916f7fe640 1 -- 172.21.15.143:0/1314571348 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917800dc10 con 0x7f91880cfc10 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.555+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91880b6400 con 0x7f91880cfc10 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.556+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918806a550 con 0x7f91880cfc10 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.556+0000 7f916f7fe640 1 -- 172.21.15.143:0/1314571348 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f917801d070 con 0x7f91880cfc10 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.557+0000 7f916f7fe640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9174076300 0x7f91740787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.557+0000 7f91867fc640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9174076300 0x7f91740787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.557+0000 7f916f7fe640 1 -- 172.21.15.143:0/1314571348 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f9178097d50 con 0x7f91880cfc10 2024-05-08T10:23:48.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.557+0000 7f91867fc640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9174076300 0x7f91740787c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f91880b6c50 tx=0x7f917c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:48.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.561+0000 7f916f7fe640 1 -- 172.21.15.143:0/1314571348 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f917809b030 con 0x7f91880cfc10 2024-05-08T10:23:48.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.742+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91880cb650 con 0x7f91880cfc10 2024-05-08T10:23:48.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.743+0000 7f916f7fe640 1 -- 172.21.15.143:0/1314571348 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7f9178061060 con 0x7f91880cfc10 2024-05-08T10:23:48.729 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:48.730 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":19,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:47.784841+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:23:45.992622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:23:46.737514+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:23:48.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9174076300 msgr2=0x7f91740787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9174076300 0x7f91740787c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f91880b6c50 tx=0x7f917c008040 comp rx=0 tx=0).stop 2024-05-08T10:23:48.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880cfc10 msgr2=0x7f91881f46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880cfc10 0x7f91881f46d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f917800cf60 tx=0x7f917800cf90 comp rx=0 tx=0).stop 2024-05-08T10:23:48.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 shutdown_connections 2024-05-08T10:23:48.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f918815f760 0x7f918815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91880d0830 0x7f918815b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9174076300 0x7f91740787c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 --2- 172.21.15.143:0/1314571348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91880cfc10 0x7f91881f46d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 >> 172.21.15.143:0/1314571348 conn(0x7f91880740e0 msgr2=0x7f918806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:48.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 shutdown_connections 2024-05-08T10:23:48.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.745+0000 7f918d319640 1 -- 172.21.15.143:0/1314571348 wait complete. 2024-05-08T10:23:48.744 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:23:48.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.857+0000 7f5b29990640 1 Processor -- start 2024-05-08T10:23:48.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.857+0000 7f5b29990640 1 -- start start 2024-05-08T10:23:48.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b29990640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5b2415f760 0x7f5b240b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b29990640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b240cfc10 0x7f5b240d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b29990640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b240d0070 con 0x7f5b240d0830 2024-05-08T10:23:48.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b29990640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2415fb40 con 0x7f5b240cfc10 2024-05-08T10:23:48.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b29990640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f5b240d36f0 con 0x7f5b2415f760 2024-05-08T10:23:48.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b1a7fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b240cfc10 0x7f5b240d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b1a7fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b240cfc10 0x7f5b240d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58682/0 (socket says 172.21.15.143:58682) 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b1a7fc640 1 -- 172.21.15.143:0/34338689 learned_addr learned my addr 172.21.15.143:0/34338689 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b22ffd640 1 --2- 172.21.15.143:0/34338689 >> v2:172.21.15.163:3300/0 conn(0x7f5b2415f760 0x7f5b240b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b1a7fc640 1 -- 172.21.15.143:0/34338689 >> v2:172.21.15.163:3300/0 conn(0x7f5b2415f760 msgr2=0x7f5b240b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b1a7fc640 1 --2- 172.21.15.143:0/34338689 >> v2:172.21.15.163:3300/0 conn(0x7f5b2415f760 0x7f5b240b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b1a7fc640 1 -- 172.21.15.143:0/34338689 >> v1:172.21.15.163:6789/0 conn(0x7f5b240d0830 legacy=0x7f5b240b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.858+0000 7f5b1a7fc640 1 -- 172.21.15.143:0/34338689 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b240d39d0 con 0x7f5b240cfc10 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b1a7fc640 1 --2- 172.21.15.143:0/34338689 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b240cfc10 0x7f5b240d02f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b240d2860 tx=0x7f5b0c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c697eed7299b36 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b227fc640 1 -- 172.21.15.143:0/34338689 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c037070 con 0x7f5b240cfc10 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b227fc640 1 -- 172.21.15.143:0/34338689 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c032440 con 0x7f5b240cfc10 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b227fc640 1 -- 172.21.15.143:0/34338689 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c032810 con 0x7f5b240cfc10 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b29990640 1 -- 172.21.15.143:0/34338689 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b240cfc10 msgr2=0x7f5b240d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b29990640 1 --2- 172.21.15.143:0/34338689 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b240cfc10 0x7f5b240d02f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b240d2860 tx=0x7f5b0c02a140 comp rx=0 tx=0).stop 2024-05-08T10:23:48.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b29990640 1 -- 172.21.15.143:0/34338689 shutdown_connections 2024-05-08T10:23:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b29990640 1 --2- 172.21.15.143:0/34338689 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b240cfc10 0x7f5b240d02f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b29990640 1 --2- 172.21.15.143:0/34338689 >> v2:172.21.15.163:3300/0 conn(0x7f5b2415f760 0x7f5b240b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.859+0000 7f5b29990640 1 -- 172.21.15.143:0/34338689 >> 172.21.15.143:0/34338689 conn(0x7f5b240740e0 msgr2=0x7f5b2406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.860+0000 7f5b29990640 1 -- 172.21.15.143:0/34338689 shutdown_connections 2024-05-08T10:23:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.860+0000 7f5b29990640 1 -- 172.21.15.143:0/34338689 wait complete. 2024-05-08T10:23:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.861+0000 7f5b29990640 1 Processor -- start 2024-05-08T10:23:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.861+0000 7f5b29990640 1 -- start start 2024-05-08T10:23:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b29990640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b240cfc10 0x7f5b241eaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b29990640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b240d0830 0x7f5b241f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b29990640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b2415f760 0x7f5b241f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b29990640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5b240d4270 con 0x7f5b2415f760 2024-05-08T10:23:48.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b29990640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5b240d3f90 con 0x7f5b240cfc10 2024-05-08T10:23:48.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b29990640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f5b240b9720 con 0x7f5b240d0830 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b237fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b2415f760 0x7f5b241f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b237fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b2415f760 0x7f5b241f94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58694/0 (socket says 172.21.15.143:58694) 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b237fe640 1 -- 172.21.15.143:0/1357141192 learned_addr learned my addr 172.21.15.143:0/1357141192 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b22ffd640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b240cfc10 0x7f5b241eaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b1a7fc640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b240d0830 0x7f5b241f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b237fe640 1 -- 172.21.15.143:0/1357141192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b240d0830 msgr2=0x7f5b241f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b237fe640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b240d0830 0x7f5b241f8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b237fe640 1 -- 172.21.15.143:0/1357141192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b240cfc10 msgr2=0x7f5b241eaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b237fe640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b240cfc10 0x7f5b241eaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b237fe640 1 -- 172.21.15.143:0/1357141192 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b241f9e30 con 0x7f5b2415f760 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b1a7fc640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b240d0830 0x7f5b241f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b237fe640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b2415f760 0x7f5b241f94f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00b990 tx=0x7f5b1c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:48.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b20ff9640 1 -- 172.21.15.143:0/1357141192 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c019070 con 0x7f5b2415f760 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b20ff9640 1 -- 172.21.15.143:0/1357141192 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00cba0 con 0x7f5b2415f760 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b241e5db0 con 0x7f5b2415f760 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b20ff9640 1 -- 172.21.15.143:0/1357141192 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c014440 con 0x7f5b2415f760 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.862+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b241e6370 con 0x7f5b2415f760 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.863+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b240d1260 con 0x7f5b2415f760 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.864+0000 7f5b20ff9640 1 -- 172.21.15.143:0/1357141192 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5b1c01c070 con 0x7f5b2415f760 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.864+0000 7f5b20ff9640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5b040762d0 0x7f5b04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.864+0000 7f5b22ffd640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5b040762d0 0x7f5b04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.864+0000 7f5b20ff9640 1 -- 172.21.15.143:0/1357141192 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f5b1c0971e0 con 0x7f5b2415f760 2024-05-08T10:23:48.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.865+0000 7f5b22ffd640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5b040762d0 0x7f5b04078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400aac0 tx=0x7f5b14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:48.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:48.869+0000 7f5b20ff9640 1 -- 172.21.15.143:0/1357141192 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5b240d1260 con 0x7f5b2415f760 2024-05-08T10:23:49.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.048+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b2406a550 con 0x7f5b2415f760 2024-05-08T10:23:49.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.049+0000 7f5b20ff9640 1 -- 172.21.15.143:0/1357141192 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7f5b1c060580 con 0x7f5b2415f760 2024-05-08T10:23:49.035 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:49.036 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":19,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:47.784841+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:23:45.992622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:23:46.737514+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:23:49.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5b040762d0 msgr2=0x7f5b04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5b040762d0 0x7f5b04078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400aac0 tx=0x7f5b14008040 comp rx=0 tx=0).stop 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b2415f760 msgr2=0x7f5b241f94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b2415f760 0x7f5b241f94f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00b990 tx=0x7f5b1c00be50 comp rx=0 tx=0).stop 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 shutdown_connections 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5b040762d0 0x7f5b04078790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b2415f760 0x7f5b241f94f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b240d0830 0x7f5b241f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 --2- 172.21.15.143:0/1357141192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b240cfc10 0x7f5b241eaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 >> 172.21.15.143:0/1357141192 conn(0x7f5b240740e0 msgr2=0x7f5b240cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:49.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 shutdown_connections 2024-05-08T10:23:49.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.051+0000 7f5b29990640 1 -- 172.21.15.143:0/1357141192 wait complete. 2024-05-08T10:23:49.049 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T10:23:49.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.165+0000 7f7c50e72640 1 Processor -- start 2024-05-08T10:23:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.165+0000 7f7c50e72640 1 -- start start 2024-05-08T10:23:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.165+0000 7f7c50e72640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7c4c148d90 0x7f7c4c0d2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.165+0000 7f7c50e72640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c0d34e0 0x7f7c4c0b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.165+0000 7f7c50e72640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4c162fd0 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c50e72640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7c4c0d3940 con 0x7f7c4c148d90 2024-05-08T10:23:49.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c50e72640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b7070 con 0x7f7c4c0d34e0 2024-05-08T10:23:49.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c43fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c0d34e0 0x7f7c4c0b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c4a59c640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7c4c148d90 0x7f7c4c0d2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c43fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c0d34e0 0x7f7c4c0b63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:56036/0 (socket says 172.21.15.143:56036) 2024-05-08T10:23:49.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c43fff640 1 -- 172.21.15.143:0/3209770142 learned_addr learned my addr 172.21.15.143:0/3209770142 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:49.154 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c4ad9d640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f7c4c0b68f0 0x7f7c4c071d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:54426/0 (socket says 172.21.15.143:54426) 2024-05-08T10:23:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c43fff640 1 -- 172.21.15.143:0/3209770142 >> v2:172.21.15.163:3300/0 conn(0x7f7c4c148d90 msgr2=0x7f7c4c0d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c43fff640 1 --2- 172.21.15.143:0/3209770142 >> v2:172.21.15.163:3300/0 conn(0x7f7c4c148d90 0x7f7c4c0d2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c43fff640 1 -- 172.21.15.143:0/3209770142 >> v1:172.21.15.163:6789/0 conn(0x7f7c4c0b68f0 legacy=0x7f7c4c071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c43fff640 1 -- 172.21.15.143:0/3209770142 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c1632b0 con 0x7f7c4c0d34e0 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.166+0000 7f7c4a59c640 1 --2- 172.21.15.143:0/3209770142 >> v2:172.21.15.163:3300/0 conn(0x7f7c4c148d90 0x7f7c4c0d2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.167+0000 7f7c43fff640 1 --2- 172.21.15.143:0/3209770142 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c0d34e0 0x7f7c4c0b63b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009870 tx=0x7f7c3402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce9985f947f2cb08 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.167+0000 7f7c49d9b640 1 -- 172.21.15.143:0/3209770142 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c34037070 con 0x7f7c4c0d34e0 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.167+0000 7f7c49d9b640 1 -- 172.21.15.143:0/3209770142 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c34032440 con 0x7f7c4c0d34e0 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.167+0000 7f7c49d9b640 1 -- 172.21.15.143:0/3209770142 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c34032810 con 0x7f7c4c0d34e0 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.168+0000 7f7c50e72640 1 -- 172.21.15.143:0/3209770142 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c0d34e0 msgr2=0x7f7c4c0b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.168+0000 7f7c50e72640 1 --2- 172.21.15.143:0/3209770142 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c0d34e0 0x7f7c4c0b63b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009870 tx=0x7f7c3402a1c0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.168+0000 7f7c50e72640 1 -- 172.21.15.143:0/3209770142 shutdown_connections 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.168+0000 7f7c50e72640 1 --2- 172.21.15.143:0/3209770142 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c0d34e0 0x7f7c4c0b63b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.168+0000 7f7c50e72640 1 --2- 172.21.15.143:0/3209770142 >> v2:172.21.15.163:3300/0 conn(0x7f7c4c148d90 0x7f7c4c0d2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.168+0000 7f7c50e72640 1 -- 172.21.15.143:0/3209770142 >> 172.21.15.143:0/3209770142 conn(0x7f7c4c0b4da0 msgr2=0x7f7c4c0b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.168+0000 7f7c50e72640 1 -- 172.21.15.143:0/3209770142 shutdown_connections 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.168+0000 7f7c50e72640 1 -- 172.21.15.143:0/3209770142 wait complete. 2024-05-08T10:23:49.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.169+0000 7f7c50e72640 1 Processor -- start 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.169+0000 7f7c50e72640 1 -- start start 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c50e72640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4c0b68f0 0x7f7c4c143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c50e72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4c0d34e0 0x7f7c4c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c50e72640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c148d90 0x7f7c4c0d1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c50e72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c163d90 con 0x7f7c4c0d34e0 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c50e72640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c163870 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c50e72640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b6d60 con 0x7f7c4c148d90 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4a59c640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4c0b68f0 0x7f7c4c143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c43fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4c0d34e0 0x7f7c4c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4a59c640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4c0b68f0 0x7f7c4c143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:52204/0 (socket says 172.21.15.143:52204) 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4a59c640 1 -- 172.21.15.143:0/4260237603 learned_addr learned my addr 172.21.15.143:0/4260237603 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c43fff640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4c0d34e0 0x7f7c4c15eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58704/0 (socket says 172.21.15.143:58704) 2024-05-08T10:23:49.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4ad9d640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c148d90 0x7f7c4c0d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4a59c640 1 -- 172.21.15.143:0/4260237603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c148d90 msgr2=0x7f7c4c0d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4a59c640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c148d90 0x7f7c4c0d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4a59c640 1 -- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4c0d34e0 msgr2=0x7f7c4c15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4a59c640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4c0d34e0 0x7f7c4c15eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4a59c640 1 -- 172.21.15.143:0/4260237603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c1f6390 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c43fff640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4c0d34e0 0x7f7c4c15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.170+0000 7f7c4a59c640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4c0b68f0 0x7f7c4c143fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00ebe0 tx=0x7f7c3c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.171+0000 7f7c42ffd640 1 -- 172.21.15.143:0/4260237603 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c017070 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.171+0000 7f7c42ffd640 1 -- 172.21.15.143:0/4260237603 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c00cc30 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.171+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c1f6670 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.171+0000 7f7c42ffd640 1 -- 172.21.15.143:0/4260237603 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c013470 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.171+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c1437e0 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.171+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c075dc0 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.172+0000 7f7c42ffd640 1 -- 172.21.15.143:0/4260237603 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7c3c01a070 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.173+0000 7f7c42ffd640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7c2c0762d0 0x7f7c2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.173+0000 7f7c43fff640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7c2c0762d0 0x7f7c2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.173+0000 7f7c42ffd640 1 -- 172.21.15.143:0/4260237603 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f7c3c097cc0 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.173+0000 7f7c43fff640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7c2c0762d0 0x7f7c2c078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c34034000 tx=0x7f7c3402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:49.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.177+0000 7f7c42ffd640 1 -- 172.21.15.143:0/4260237603 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7c3c060fd0 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.399+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7c4c13f640 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.438+0000 7f7c42ffd640 1 -- 172.21.15.143:0/4260237603 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f7c3c0652d0 con 0x7f7c4c0b68f0 2024-05-08T10:23:49.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7c2c0762d0 msgr2=0x7f7c2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7c2c0762d0 0x7f7c2c078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c34034000 tx=0x7f7c3402e000 comp rx=0 tx=0).stop 2024-05-08T10:23:49.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4c0b68f0 msgr2=0x7f7c4c143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4c0b68f0 0x7f7c4c143fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00ebe0 tx=0x7f7c3c00c520 comp rx=0 tx=0).stop 2024-05-08T10:23:49.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 shutdown_connections 2024-05-08T10:23:49.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4c148d90 0x7f7c4c0d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7c2c0762d0 0x7f7c2c078790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c4c0d34e0 0x7f7c4c15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 --2- 172.21.15.143:0/4260237603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4c0b68f0 0x7f7c4c143fe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 >> 172.21.15.143:0/4260237603 conn(0x7f7c4c0b4da0 msgr2=0x7f7c4c0b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:49.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 shutdown_connections 2024-05-08T10:23:49.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.441+0000 7f7c50e72640 1 -- 172.21.15.143:0/4260237603 wait complete. 2024-05-08T10:23:49.438 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-08T10:23:49.438 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T10:23:49.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.555+0000 7f5223346640 1 Processor -- start 2024-05-08T10:23:49.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.555+0000 7f5223346640 1 -- start start 2024-05-08T10:23:49.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f5223346640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f521c148e20 0x7f521c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f5223346640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c162ea0 0x7f521c0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f5223346640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f521c06de40 con 0x7f521c0b6910 2024-05-08T10:23:49.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f5223346640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f521c06e0e0 con 0x7f521c148e20 2024-05-08T10:23:49.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f5223346640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f521c06e3c0 con 0x7f521c162ea0 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f52210e2640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f521c148e20 0x7f521c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f52208e1640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c162ea0 0x7f521c0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f52218e3640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f521c0b6910 0x7f521c071e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:54442/0 (socket says 172.21.15.143:54442) 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f52210e2640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f521c148e20 0x7f521c06d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:52208/0 (socket says 172.21.15.143:52208) 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.556+0000 7f52218e3640 1 -- 172.21.15.143:0/4261596036 learned_addr learned my addr 172.21.15.143:0/4261596036 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.557+0000 7f52210e2640 1 -- 172.21.15.143:0/4261596036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c162ea0 msgr2=0x7f521c0b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.557+0000 7f52210e2640 1 --2- 172.21.15.143:0/4261596036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c162ea0 0x7f521c0b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.557+0000 7f52210e2640 1 -- 172.21.15.143:0/4261596036 >> v1:172.21.15.163:6789/0 conn(0x7f521c0b6910 legacy=0x7f521c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.557+0000 7f52210e2640 1 -- 172.21.15.143:0/4261596036 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c06e6a0 con 0x7f521c148e20 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.557+0000 7f52208e1640 1 --2- 172.21.15.143:0/4261596036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c162ea0 0x7f521c0b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f52210e2640 1 --2- 172.21.15.143:0/4261596036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f521c148e20 0x7f521c06d900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f520c0097a0 tx=0x7f520c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73808fa02cd3efb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:49.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f521bfff640 1 -- 172.21.15.143:0/4261596036 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c037070 con 0x7f521c148e20 2024-05-08T10:23:49.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f521bfff640 1 -- 172.21.15.143:0/4261596036 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520c032440 con 0x7f521c148e20 2024-05-08T10:23:49.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f521bfff640 1 -- 172.21.15.143:0/4261596036 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c032810 con 0x7f521c148e20 2024-05-08T10:23:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f5223346640 1 -- 172.21.15.143:0/4261596036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f521c148e20 msgr2=0x7f521c06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f5223346640 1 --2- 172.21.15.143:0/4261596036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f521c148e20 0x7f521c06d900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f520c0097a0 tx=0x7f520c02a180 comp rx=0 tx=0).stop 2024-05-08T10:23:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f5223346640 1 -- 172.21.15.143:0/4261596036 shutdown_connections 2024-05-08T10:23:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f5223346640 1 --2- 172.21.15.143:0/4261596036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c162ea0 0x7f521c0b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f5223346640 1 --2- 172.21.15.143:0/4261596036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f521c148e20 0x7f521c06d900 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f5223346640 1 -- 172.21.15.143:0/4261596036 >> 172.21.15.143:0/4261596036 conn(0x7f521c0706c0 msgr2=0x7f521c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:49.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f5223346640 1 -- 172.21.15.143:0/4261596036 shutdown_connections 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.558+0000 7f5223346640 1 -- 172.21.15.143:0/4261596036 wait complete. 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.559+0000 7f5223346640 1 Processor -- start 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f5223346640 1 -- start start 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f5223346640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f521c0b6910 0x7f521c142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f5223346640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c148e20 0x7f521c1474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f5223346640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c162ea0 0x7f521c0d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f5223346640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f521c160e40 con 0x7f521c162ea0 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f5223346640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f521c160cc0 con 0x7f521c0b6910 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f5223346640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f521c160fc0 con 0x7f521c148e20 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f52218e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c162ea0 0x7f521c0d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f52218e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c162ea0 0x7f521c0d2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58718/0 (socket says 172.21.15.143:58718) 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f52218e3640 1 -- 172.21.15.143:0/414265972 learned_addr learned my addr 172.21.15.143:0/414265972 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f52208e1640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c148e20 0x7f521c1474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.560+0000 7f52210e2640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f521c0b6910 0x7f521c142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f52218e3640 1 -- 172.21.15.143:0/414265972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c148e20 msgr2=0x7f521c1474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f52218e3640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c148e20 0x7f521c1474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f52218e3640 1 -- 172.21.15.143:0/414265972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f521c0b6910 msgr2=0x7f521c142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f52218e3640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f521c0b6910 0x7f521c142c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f52218e3640 1 -- 172.21.15.143:0/414265972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c0d3a50 con 0x7f521c162ea0 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f52218e3640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c162ea0 0x7f521c0d2bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f521400cb50 tx=0x7f521400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f5219ffb640 1 -- 172.21.15.143:0/414265972 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214017070 con 0x7f521c162ea0 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f5219ffb640 1 -- 172.21.15.143:0/414265972 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521400ace0 con 0x7f521c162ea0 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c145a80 con 0x7f521c162ea0 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f5219ffb640 1 -- 172.21.15.143:0/414265972 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214012600 con 0x7f521c162ea0 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.561+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c146040 con 0x7f521c162ea0 2024-05-08T10:23:49.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.562+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521c06a550 con 0x7f521c162ea0 2024-05-08T10:23:49.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.563+0000 7f5219ffb640 1 -- 172.21.15.143:0/414265972 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f521401a070 con 0x7f521c162ea0 2024-05-08T10:23:49.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.563+0000 7f5219ffb640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5208076300 0x7f52080787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:49.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.563+0000 7f5219ffb640 1 -- 172.21.15.143:0/414265972 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5214097170 con 0x7f521c162ea0 2024-05-08T10:23:49.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.563+0000 7f52210e2640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5208076300 0x7f52080787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:49.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.564+0000 7f52210e2640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5208076300 0x7f52080787c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f520c034000 tx=0x7f520c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:49.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.567+0000 7f5219ffb640 1 -- 172.21.15.143:0/414265972 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5214060510 con 0x7f521c162ea0 2024-05-08T10:23:49.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:49.785+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f521c072d40 con 0x7f521c162ea0 2024-05-08T10:23:50.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.441+0000 7f5219ffb640 1 -- 172.21.15.143:0/414265972 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f5214064810 con 0x7f521c162ea0 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5208076300 msgr2=0x7f52080787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5208076300 0x7f52080787c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f520c034000 tx=0x7f520c02e000 comp rx=0 tx=0).stop 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c162ea0 msgr2=0x7f521c0d2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c162ea0 0x7f521c0d2bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f521400cb50 tx=0x7f521400a430 comp rx=0 tx=0).stop 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 shutdown_connections 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5208076300 0x7f52080787c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f521c162ea0 0x7f521c0d2bb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f521c148e20 0x7f521c1474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 --2- 172.21.15.143:0/414265972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f521c0b6910 0x7f521c142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.443+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 >> 172.21.15.143:0/414265972 conn(0x7f521c0706c0 msgr2=0x7f521c162140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:50.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.444+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 shutdown_connections 2024-05-08T10:23:50.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.444+0000 7f5223346640 1 -- 172.21.15.143:0/414265972 wait complete. 2024-05-08T10:23:50.441 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T10:23:50.442 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:23:50.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.558+0000 7f7ef1645640 1 Processor -- start 2024-05-08T10:23:50.544 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.558+0000 7f7ef1645640 1 -- start start 2024-05-08T10:23:50.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.558+0000 7f7ef1645640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 0x7f7eec0d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.558+0000 7f7ef1645640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7eec0d4050 0x7f7eec0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.558+0000 7f7ef1645640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eec0d1240 con 0x7f7eec0b3f50 2024-05-08T10:23:50.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.558+0000 7f7ef1645640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7eec0d3750 con 0x7f7eec0d4050 2024-05-08T10:23:50.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.558+0000 7f7ef1645640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7eec0d2750 con 0x7f7eec15f640 2024-05-08T10:23:50.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7eea7fc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7eec0b3f50 0x7f7eec0d3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54232/0 (socket says 172.21.15.143:54232) 2024-05-08T10:23:50.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7eea7fc640 1 -- 172.21.15.143:0/1939232386 learned_addr learned my addr 172.21.15.143:0/1939232386 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:50.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7eeaffd640 1 --2- 172.21.15.143:0/1939232386 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 0x7f7eec0d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7eeb7fe640 1 --2- 172.21.15.143:0/1939232386 >> v2:172.21.15.163:3300/0 conn(0x7f7eec0d4050 0x7f7eec0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7ee9ffb640 1 -- 172.21.15.143:0/1939232386 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2233111435 0 0) 0x7f7eec0d1240 con 0x7f7eec0b3f50 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7ee9ffb640 1 -- 172.21.15.143:0/1939232386 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ed4003520 con 0x7f7eec0b3f50 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7eeaffd640 1 -- 172.21.15.143:0/1939232386 >> v2:172.21.15.163:3300/0 conn(0x7f7eec0d4050 msgr2=0x7f7eec0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7eeaffd640 1 --2- 172.21.15.143:0/1939232386 >> v2:172.21.15.163:3300/0 conn(0x7f7eec0d4050 0x7f7eec0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7eeaffd640 1 -- 172.21.15.143:0/1939232386 >> v1:172.21.15.143:6789/0 conn(0x7f7eec0b3f50 legacy=0x7f7eec0d3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7eeaffd640 1 -- 172.21.15.143:0/1939232386 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eec0d5c10 con 0x7f7eec15f640 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.559+0000 7f7eeb7fe640 1 --2- 172.21.15.143:0/1939232386 >> v2:172.21.15.163:3300/0 conn(0x7f7eec0d4050 0x7f7eec0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.560+0000 7f7eeaffd640 1 --2- 172.21.15.143:0/1939232386 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 0x7f7eec0d3210 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0097a0 tx=0x7f7edc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdacac06cff4b27c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.560+0000 7f7ee9ffb640 1 -- 172.21.15.143:0/1939232386 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc037070 con 0x7f7eec15f640 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.560+0000 7f7ee9ffb640 1 -- 172.21.15.143:0/1939232386 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7edc032440 con 0x7f7eec15f640 2024-05-08T10:23:50.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.560+0000 7f7ee9ffb640 1 -- 172.21.15.143:0/1939232386 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0327f0 con 0x7f7eec15f640 2024-05-08T10:23:50.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.560+0000 7f7ef1645640 1 -- 172.21.15.143:0/1939232386 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 msgr2=0x7f7eec0d3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.560+0000 7f7ef1645640 1 --2- 172.21.15.143:0/1939232386 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 0x7f7eec0d3210 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0097a0 tx=0x7f7edc02a180 comp rx=0 tx=0).stop 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.561+0000 7f7ef1645640 1 -- 172.21.15.143:0/1939232386 shutdown_connections 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.561+0000 7f7ef1645640 1 --2- 172.21.15.143:0/1939232386 >> v2:172.21.15.163:3300/0 conn(0x7f7eec0d4050 0x7f7eec0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.561+0000 7f7ef1645640 1 --2- 172.21.15.143:0/1939232386 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 0x7f7eec0d3210 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.561+0000 7f7ef1645640 1 -- 172.21.15.143:0/1939232386 >> 172.21.15.143:0/1939232386 conn(0x7f7eec09e5b0 msgr2=0x7f7eec0d5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.561+0000 7f7ef1645640 1 -- 172.21.15.143:0/1939232386 shutdown_connections 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.561+0000 7f7ef1645640 1 -- 172.21.15.143:0/1939232386 wait complete. 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.562+0000 7f7ef1645640 1 Processor -- start 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.562+0000 7f7ef1645640 1 -- start start 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ef1645640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eec0b3f50 0x7f7eec160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ef1645640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7eec0d4050 0x7f7eec161640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.551 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ef1645640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 0x7f7eec1f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ef1645640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec15fa20 con 0x7f7eec0b3f50 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ef1645640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec0d61d0 con 0x7f7eec0d4050 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ef1645640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7eec0b1ea0 con 0x7f7eec15f640 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeaffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eec0b3f50 0x7f7eec160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeaffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eec0b3f50 0x7f7eec160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58734/0 (socket says 172.21.15.143:58734) 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeaffd640 1 -- 172.21.15.143:0/1122950349 learned_addr learned my addr 172.21.15.143:0/1122950349 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeb7fe640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 0x7f7eec1f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eea7fc640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7eec0d4050 0x7f7eec161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeaffd640 1 -- 172.21.15.143:0/1122950349 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 msgr2=0x7f7eec1f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeaffd640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 0x7f7eec1f4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeaffd640 1 -- 172.21.15.143:0/1122950349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7eec0d4050 msgr2=0x7f7eec161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeaffd640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7eec0d4050 0x7f7eec161640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeaffd640 1 -- 172.21.15.143:0/1122950349 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eec161de0 con 0x7f7eec0b3f50 2024-05-08T10:23:50.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7eeaffd640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eec0b3f50 0x7f7eec160770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0097a0 tx=0x7f7edc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:50.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ed37fe640 1 -- 172.21.15.143:0/1122950349 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc037050 con 0x7f7eec0b3f50 2024-05-08T10:23:50.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ed37fe640 1 -- 172.21.15.143:0/1122950349 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7edc038040 con 0x7f7eec0b3f50 2024-05-08T10:23:50.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ed37fe640 1 -- 172.21.15.143:0/1122950349 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc004490 con 0x7f7eec0b3f50 2024-05-08T10:23:50.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eec1620c0 con 0x7f7eec0b3f50 2024-05-08T10:23:50.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.563+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eec162680 con 0x7f7eec0b3f50 2024-05-08T10:23:50.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.564+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eec06a550 con 0x7f7eec0b3f50 2024-05-08T10:23:50.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.565+0000 7f7ed37fe640 1 -- 172.21.15.143:0/1122950349 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7edc003610 con 0x7f7eec0b3f50 2024-05-08T10:23:50.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.565+0000 7f7ed37fe640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7ed80762d0 0x7f7ed8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.566+0000 7f7eea7fc640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7ed80762d0 0x7f7ed8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.566+0000 7f7ed37fe640 1 -- 172.21.15.143:0/1122950349 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7edc0b7e50 con 0x7f7eec0b3f50 2024-05-08T10:23:50.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.566+0000 7f7eea7fc640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7ed80762d0 0x7f7ed8078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7eec1615d0 tx=0x7f7ee0006aa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:50.556 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.570+0000 7f7ed37fe640 1 -- 172.21.15.143:0/1122950349 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7edc081720 con 0x7f7eec0b3f50 2024-05-08T10:23:50.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.786+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7eec06ef20 con 0x7f7eec0b3f50 2024-05-08T10:23:50.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.786+0000 7f7ed37fe640 1 -- 172.21.15.143:0/1122950349 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7f7edc081020 con 0x7f7eec0b3f50 2024-05-08T10:23:50.773 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:50.773 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/3021671777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3021671777},{"type":"v1","addr":"172.21.15.163:6834","nonce":3021671777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2147988445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":2147988445},{"type":"v1","addr":"172.21.15.163:6835","nonce":2147988445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/4179295945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":4179295945},{"type":"v1","addr":"172.21.15.143:6836","nonce":4179295945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:23:47.784804+0000","modified":"2024-05-08T10:23:49.788119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-05-08T10:23:50.773 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 6 2024-05-08T10:23:50.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.788+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7ed80762d0 msgr2=0x7f7ed8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.788+0000 7f7ef1645640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7ed80762d0 0x7f7ed8078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7eec1615d0 tx=0x7f7ee0006aa0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eec0b3f50 msgr2=0x7f7eec160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eec0b3f50 0x7f7eec160770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0097a0 tx=0x7f7edc0046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 shutdown_connections 2024-05-08T10:23:50.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7eec15f640 0x7f7eec1f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7eec0d4050 0x7f7eec161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7ed80762d0 0x7f7ed8078790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 --2- 172.21.15.143:0/1122950349 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7eec0b3f50 0x7f7eec160770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 >> 172.21.15.143:0/1122950349 conn(0x7f7eec09e5b0 msgr2=0x7f7eec06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:50.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 shutdown_connections 2024-05-08T10:23:50.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.789+0000 7f7ef1645640 1 -- 172.21.15.143:0/1122950349 wait complete. 2024-05-08T10:23:50.787 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:23:50.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.901+0000 7f580e659640 1 Processor -- start 2024-05-08T10:23:50.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.901+0000 7f580e659640 1 -- start start 2024-05-08T10:23:50.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.901+0000 7f580e659640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f580815f760 0x7f58080b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.901+0000 7f580e659640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f58080cfc10 0x7f58080d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.901+0000 7f580e659640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58080d0070 con 0x7f58080d0830 2024-05-08T10:23:50.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.901+0000 7f580e659640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f580815fb40 con 0x7f58080cfc10 2024-05-08T10:23:50.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.901+0000 7f580e659640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f58080d36f0 con 0x7f580815f760 2024-05-08T10:23:50.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f5807fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f580815f760 0x7f58080b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f58077fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f58080cfc10 0x7f58080d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f5807fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f580815f760 0x7f58080b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:56100/0 (socket says 172.21.15.143:56100) 2024-05-08T10:23:50.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f58077fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f58080cfc10 0x7f58080d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:52234/0 (socket says 172.21.15.143:52234) 2024-05-08T10:23:50.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f5807fff640 1 -- 172.21.15.143:0/3356289472 learned_addr learned my addr 172.21.15.143:0/3356289472 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:50.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f5807fff640 1 -- 172.21.15.143:0/3356289472 >> v2:172.21.15.163:3300/0 conn(0x7f58080cfc10 msgr2=0x7f58080d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:50.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f5807fff640 1 --2- 172.21.15.143:0/3356289472 >> v2:172.21.15.163:3300/0 conn(0x7f58080cfc10 0x7f58080d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f5807fff640 1 -- 172.21.15.143:0/3356289472 >> v1:172.21.15.163:6789/0 conn(0x7f58080d0830 legacy=0x7f58080b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f5807fff640 1 -- 172.21.15.143:0/3356289472 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58080d39d0 con 0x7f580815f760 2024-05-08T10:23:50.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.902+0000 7f58077fe640 1 --2- 172.21.15.143:0/3356289472 >> v2:172.21.15.163:3300/0 conn(0x7f58080cfc10 0x7f58080d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:50.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.903+0000 7f5807fff640 1 --2- 172.21.15.143:0/3356289472 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f580815f760 0x7f58080b4770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009870 tx=0x7f57f802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55c5dd8f8b93d88f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.903+0000 7f5806ffd640 1 -- 172.21.15.143:0/3356289472 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8037070 con 0x7f580815f760 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.903+0000 7f5806ffd640 1 -- 172.21.15.143:0/3356289472 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f8032440 con 0x7f580815f760 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.903+0000 7f5806ffd640 1 -- 172.21.15.143:0/3356289472 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8032810 con 0x7f580815f760 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.904+0000 7f580e659640 1 -- 172.21.15.143:0/3356289472 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f580815f760 msgr2=0x7f58080b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.904+0000 7f580e659640 1 --2- 172.21.15.143:0/3356289472 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f580815f760 0x7f58080b4770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009870 tx=0x7f57f802a1c0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.904+0000 7f580e659640 1 -- 172.21.15.143:0/3356289472 shutdown_connections 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.904+0000 7f580e659640 1 --2- 172.21.15.143:0/3356289472 >> v2:172.21.15.163:3300/0 conn(0x7f58080cfc10 0x7f58080d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.904+0000 7f580e659640 1 --2- 172.21.15.143:0/3356289472 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f580815f760 0x7f58080b4770 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.904+0000 7f580e659640 1 -- 172.21.15.143:0/3356289472 >> 172.21.15.143:0/3356289472 conn(0x7f58080740e0 msgr2=0x7f580806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.904+0000 7f580e659640 1 -- 172.21.15.143:0/3356289472 shutdown_connections 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.904+0000 7f580e659640 1 -- 172.21.15.143:0/3356289472 wait complete. 2024-05-08T10:23:50.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.905+0000 7f580e659640 1 Processor -- start 2024-05-08T10:23:50.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.905+0000 7f580e659640 1 -- start start 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580e659640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58080cfc10 0x7f58081f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580e659640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58080d0830 0x7f5808154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580e659640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f580815f760 0x7f5808157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580e659640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f58080d4270 con 0x7f58080cfc10 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580e659640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f58080d3f90 con 0x7f580815f760 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580e659640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f58080b9720 con 0x7f58080d0830 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5807fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58080cfc10 0x7f58081f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5807fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58080cfc10 0x7f58081f98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58746/0 (socket says 172.21.15.143:58746) 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5807fff640 1 -- 172.21.15.143:0/1296096551 learned_addr learned my addr 172.21.15.143:0/1296096551 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580cbf6640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f580815f760 0x7f5808157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f58077fe640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58080d0830 0x7f5808154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5807fff640 1 -- 172.21.15.143:0/1296096551 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58080d0830 msgr2=0x7f5808154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5807fff640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58080d0830 0x7f5808154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5807fff640 1 -- 172.21.15.143:0/1296096551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f580815f760 msgr2=0x7f5808157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5807fff640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f580815f760 0x7f5808157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5807fff640 1 -- 172.21.15.143:0/1296096551 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58081f9df0 con 0x7f58080cfc10 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580cbf6640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f580815f760 0x7f5808157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5807fff640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58080cfc10 0x7f58081f98b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f57f8000c00 tx=0x7f57f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5804ff9640 1 -- 172.21.15.143:0/1296096551 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8037040 con 0x7f58080cfc10 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5804ff9640 1 -- 172.21.15.143:0/1296096551 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f8042070 con 0x7f58080cfc10 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58081549c0 con 0x7f58080cfc10 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f5804ff9640 1 -- 172.21.15.143:0/1296096551 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8030880 con 0x7f58080cfc10 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.906+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5808156990 con 0x7f58080cfc10 2024-05-08T10:23:50.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.907+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580806a550 con 0x7f58080cfc10 2024-05-08T10:23:50.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.908+0000 7f5804ff9640 1 -- 172.21.15.143:0/1296096551 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f57f802ad10 con 0x7f58080cfc10 2024-05-08T10:23:50.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.909+0000 7f5804ff9640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f57f40762d0 0x7f57f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:50.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.909+0000 7f58077fe640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f57f40762d0 0x7f57f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:50.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.909+0000 7f5804ff9640 1 -- 172.21.15.143:0/1296096551 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f57f80b7a00 con 0x7f58080cfc10 2024-05-08T10:23:50.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.909+0000 7f58077fe640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f57f40762d0 0x7f57f4078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009560 tx=0x7f57fc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:50.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:50.913+0000 7f5804ff9640 1 -- 172.21.15.143:0/1296096551 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f58081f9df0 con 0x7f58080cfc10 2024-05-08T10:23:51.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.093+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58080cf0e0 con 0x7f58080cfc10 2024-05-08T10:23:51.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.094+0000 7f5804ff9640 1 -- 172.21.15.143:0/1296096551 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f57f8080da0 con 0x7f58080cfc10 2024-05-08T10:23:51.080 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:51.081 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:49.433403+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:23:45.992622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:23:46.737514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f57f40762d0 msgr2=0x7f57f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f57f40762d0 0x7f57f4078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009560 tx=0x7f57fc009190 comp rx=0 tx=0).stop 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58080cfc10 msgr2=0x7f58081f98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58080cfc10 0x7f58081f98b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f57f8000c00 tx=0x7f57f80046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 shutdown_connections 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f580815f760 0x7f5808157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f58080d0830 0x7f5808154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f57f40762d0 0x7f57f4078790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 --2- 172.21.15.143:0/1296096551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58080cfc10 0x7f58081f98b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 >> 172.21.15.143:0/1296096551 conn(0x7f58080740e0 msgr2=0x7f58080ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:51.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 shutdown_connections 2024-05-08T10:23:51.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.096+0000 7f580e659640 1 -- 172.21.15.143:0/1296096551 wait complete. 2024-05-08T10:23:51.094 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T10:23:51.094 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:23:51.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.208+0000 7f0ed69b6640 1 Processor -- start 2024-05-08T10:23:51.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.208+0000 7f0ed69b6640 1 -- start start 2024-05-08T10:23:51.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.208+0000 7f0ed69b6640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0ed0142810 0x7f0ed0142c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.208+0000 7f0ed69b6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ed0140450 con 0x7f0ed01410b0 2024-05-08T10:23:51.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.208+0000 7f0ed69b6640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ed0072890 con 0x7f0ed0140070 2024-05-08T10:23:51.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.208+0000 7f0ed69b6640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed01431c0 con 0x7f0ed0142810 2024-05-08T10:23:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.209+0000 7f0ed4f53640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0ed01410b0 0x7f0ed0141500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54234/0 (socket says 172.21.15.143:54234) 2024-05-08T10:23:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.209+0000 7f0ed4f53640 1 -- 172.21.15.143:0/2844091042 learned_addr learned my addr 172.21.15.143:0/2844091042 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.209+0000 7f0ecf7fe640 1 --2- 172.21.15.143:0/2844091042 >> v2:172.21.15.163:3300/0 conn(0x7f0ed0142810 0x7f0ed0142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.209+0000 7f0eceffd640 1 -- 172.21.15.143:0/2844091042 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514567755 0 0) 0x7f0ed0140450 con 0x7f0ed01410b0 2024-05-08T10:23:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.209+0000 7f0eceffd640 1 -- 172.21.15.143:0/2844091042 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0eb8003520 con 0x7f0ed01410b0 2024-05-08T10:23:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.209+0000 7f0ecf7fe640 1 -- 172.21.15.143:0/2844091042 >> v1:172.21.15.163:6789/0 conn(0x7f0ed0140070 legacy=0x7f0ed0071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.209+0000 7f0ecf7fe640 1 -- 172.21.15.143:0/2844091042 >> v1:172.21.15.143:6789/0 conn(0x7f0ed01410b0 legacy=0x7f0ed0141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.209+0000 7f0ecf7fe640 1 -- 172.21.15.143:0/2844091042 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed0072b70 con 0x7f0ed0142810 2024-05-08T10:23:51.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.210+0000 7f0ecf7fe640 1 --2- 172.21.15.143:0/2844091042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ed0142810 0x7f0ed0142c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40097a0 tx=0x7f0ec402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ef79a7647bf11f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:51.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.210+0000 7f0eceffd640 1 -- 172.21.15.143:0/2844091042 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4037070 con 0x7f0ed0142810 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.210+0000 7f0eceffd640 1 -- 172.21.15.143:0/2844091042 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec4032440 con 0x7f0ed0142810 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.210+0000 7f0eceffd640 1 -- 172.21.15.143:0/2844091042 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec402ae60 con 0x7f0ed0142810 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.210+0000 7f0ed69b6640 1 -- 172.21.15.143:0/2844091042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ed0142810 msgr2=0x7f0ed0142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.210+0000 7f0ed69b6640 1 --2- 172.21.15.143:0/2844091042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ed0142810 0x7f0ed0142c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40097a0 tx=0x7f0ec402a110 comp rx=0 tx=0).stop 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.211+0000 7f0ed69b6640 1 -- 172.21.15.143:0/2844091042 shutdown_connections 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.211+0000 7f0ed69b6640 1 --2- 172.21.15.143:0/2844091042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ed0142810 0x7f0ed0142c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.211+0000 7f0ed69b6640 1 -- 172.21.15.143:0/2844091042 >> 172.21.15.143:0/2844091042 conn(0x7f0ed00b4da0 msgr2=0x7f0ed00b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.211+0000 7f0ed69b6640 1 -- 172.21.15.143:0/2844091042 shutdown_connections 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.211+0000 7f0ed69b6640 1 -- 172.21.15.143:0/2844091042 wait complete. 2024-05-08T10:23:51.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.212+0000 7f0ed69b6640 1 Processor -- start 2024-05-08T10:23:51.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.212+0000 7f0ed69b6640 1 -- start start 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ed69b6640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ed0140070 0x7f0ed00b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ed69b6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ed01410b0 0x7f0ed0138940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ed69b6640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ed0142810 0x7f0ed0143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ed69b6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01435b0 con 0x7f0ed01410b0 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ed69b6640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0072e50 con 0x7f0ed0142810 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ed69b6640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed00724c0 con 0x7f0ed0140070 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ed01410b0 0x7f0ed0138940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ed01410b0 0x7f0ed0138940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58748/0 (socket says 172.21.15.143:58748) 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecf7fe640 1 -- 172.21.15.143:0/3931525528 learned_addr learned my addr 172.21.15.143:0/3931525528 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecffff640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ed0140070 0x7f0ed00b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ed4f53640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ed0142810 0x7f0ed0143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecf7fe640 1 -- 172.21.15.143:0/3931525528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ed0140070 msgr2=0x7f0ed00b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecf7fe640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ed0140070 0x7f0ed00b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecf7fe640 1 -- 172.21.15.143:0/3931525528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ed0142810 msgr2=0x7f0ed0143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecf7fe640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ed0142810 0x7f0ed0143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecf7fe640 1 -- 172.21.15.143:0/3931525528 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed00b6820 con 0x7f0ed01410b0 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ecf7fe640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ed01410b0 0x7f0ed0138940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4035040 tx=0x7f0ec40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0eccff9640 1 -- 172.21.15.143:0/3931525528 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4037050 con 0x7f0ed01410b0 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0eccff9640 1 -- 172.21.15.143:0/3931525528 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec4038040 con 0x7f0ed01410b0 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed00b6b00 con 0x7f0ed01410b0 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0eccff9640 1 -- 172.21.15.143:0/3931525528 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4004450 con 0x7f0ed01410b0 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.213+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed00b70c0 con 0x7f0ed01410b0 2024-05-08T10:23:51.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.215+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed00b4700 con 0x7f0ed01410b0 2024-05-08T10:23:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.215+0000 7f0eccff9640 1 -- 172.21.15.143:0/3931525528 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ec403c6d0 con 0x7f0ed01410b0 2024-05-08T10:23:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.215+0000 7f0eccff9640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0ebc0762d0 0x7f0ebc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.216+0000 7f0ecffff640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0ebc0762d0 0x7f0ebc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.216+0000 7f0eccff9640 1 -- 172.21.15.143:0/3931525528 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0ec40b7e30 con 0x7f0ed01410b0 2024-05-08T10:23:51.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.216+0000 7f0ecffff640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0ebc0762d0 0x7f0ebc078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00017c0 tx=0x7f0ec0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:51.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.220+0000 7f0eccff9640 1 -- 172.21.15.143:0/3931525528 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ed00b4700 con 0x7f0ed01410b0 2024-05-08T10:23:51.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.396+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ed006a550 con 0x7f0ebc0762d0 2024-05-08T10:23:51.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.402+0000 7f0eccff9640 1 -- 172.21.15.143:0/3931525528 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246613 (secure 0 0 0) 0x7f0ed006a550 con 0x7f0ebc0762d0 2024-05-08T10:23:51.392 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:51.393 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.405+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0ebc0762d0 msgr2=0x7f0ebc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.405+0000 7f0ed69b6640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0ebc0762d0 0x7f0ebc078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00017c0 tx=0x7f0ec0009040 comp rx=0 tx=0).stop 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.405+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ed01410b0 msgr2=0x7f0ed0138940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.405+0000 7f0ed69b6640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ed01410b0 0x7f0ed0138940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4035040 tx=0x7f0ec40046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.406+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 shutdown_connections 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.406+0000 7f0ed69b6640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ed0142810 0x7f0ed0143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.406+0000 7f0ed69b6640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0ebc0762d0 0x7f0ebc078790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.406+0000 7f0ed69b6640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ed01410b0 0x7f0ed0138940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.406+0000 7f0ed69b6640 1 --2- 172.21.15.143:0/3931525528 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ed0140070 0x7f0ed00b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.406+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 >> 172.21.15.143:0/3931525528 conn(0x7f0ed00b4da0 msgr2=0x7f0ed0141ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:51.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.406+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 shutdown_connections 2024-05-08T10:23:51.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.406+0000 7f0ed69b6640 1 -- 172.21.15.143:0/3931525528 wait complete. 2024-05-08T10:23:51.406 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-05-08T10:23:50.524933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":2508,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":2568192,"data_stored":1612233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.101000"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431662+0000","last_change":"2024-05-08T10:23:47.431662+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431662+0000","last_undegraded":"2024-05-08T10:23:47.431662+0000","last_fullsized":"2024-05-08T10:23:47.431662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431196+0000","last_change":"2024-05-08T10:23:47.431196+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431196+0000","last_undegraded":"2024-05-08T10:23:47.431196+0000","last_fullsized":"2024-05-08T10:23:47.431196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427104+0000","last_change":"2024-05-08T10:23:47.427104+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427104+0000","last_undegraded":"2024-05-08T10:23:47.427104+0000","last_fullsized":"2024-05-08T10:23:47.427104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429800+0000","last_change":"2024-05-08T10:23:47.429800+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429800+0000","last_undegraded":"2024-05-08T10:23:47.429800+0000","last_fullsized":"2024-05-08T10:23:47.429800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.435270+0000","last_change":"2024-05-08T10:23:47.435270+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.435270+0000","last_undegraded":"2024-05-08T10:23:47.435270+0000","last_fullsized":"2024-05-08T10:23:47.435270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433166+0000","last_change":"2024-05-08T10:23:47.433166+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433166+0000","last_undegraded":"2024-05-08T10:23:47.433166+0000","last_fullsized":"2024-05-08T10:23:47.433166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431815+0000","last_change":"2024-05-08T10:23:47.431815+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431815+0000","last_undegraded":"2024-05-08T10:23:47.431815+0000","last_fullsized":"2024-05-08T10:23:47.431815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426758+0000","last_change":"2024-05-08T10:23:47.426758+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426758+0000","last_undegraded":"2024-05-08T10:23:47.426758+0000","last_fullsized":"2024-05-08T10:23:47.426758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431039+0000","last_change":"2024-05-08T10:23:47.431039+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431039+0000","last_undegraded":"2024-05-08T10:23:47.431039+0000","last_fullsized":"2024-05-08T10:23:47.431039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428458+0000","last_change":"2024-05-08T10:23:47.428458+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428458+0000","last_undegraded":"2024-05-08T10:23:47.428458+0000","last_fullsized":"2024-05-08T10:23:47.428458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426526+0000","last_change":"2024-05-08T10:23:47.426526+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426526+0000","last_undegraded":"2024-05-08T10:23:47.426526+0000","last_fullsized":"2024-05-08T10:23:47.426526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425230+0000","last_change":"2024-05-08T10:23:47.425230+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425230+0000","last_undegraded":"2024-05-08T10:23:47.425230+0000","last_fullsized":"2024-05-08T10:23:47.425230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426133+0000","last_change":"2024-05-08T10:23:47.426133+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426133+0000","last_undegraded":"2024-05-08T10:23:47.426133+0000","last_fullsized":"2024-05-08T10:23:47.426133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429210+0000","last_change":"2024-05-08T10:23:47.429210+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429210+0000","last_undegraded":"2024-05-08T10:23:47.429210+0000","last_fullsized":"2024-05-08T10:23:47.429210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431289+0000","last_change":"2024-05-08T10:23:47.431289+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431289+0000","last_undegraded":"2024-05-08T10:23:47.431289+0000","last_fullsized":"2024-05-08T10:23:47.431289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430746+0000","last_change":"2024-05-08T10:23:47.430746+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430746+0000","last_undegraded":"2024-05-08T10:23:47.430746+0000","last_fullsized":"2024-05-08T10:23:47.430746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426764+0000","last_change":"2024-05-08T10:23:47.426764+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426764+0000","last_undegraded":"2024-05-08T10:23:47.426764+0000","last_fullsized":"2024-05-08T10:23:47.426764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.422801+0000","last_change":"2024-05-08T10:23:47.422801+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.422801+0000","last_undegraded":"2024-05-08T10:23:47.422801+0000","last_fullsized":"2024-05-08T10:23:47.422801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430500+0000","last_change":"2024-05-08T10:23:47.430500+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430500+0000","last_undegraded":"2024-05-08T10:23:47.430500+0000","last_fullsized":"2024-05-08T10:23:47.430500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426934+0000","last_change":"2024-05-08T10:23:47.426934+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426934+0000","last_undegraded":"2024-05-08T10:23:47.426934+0000","last_fullsized":"2024-05-08T10:23:47.426934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430150+0000","last_change":"2024-05-08T10:23:47.430150+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430150+0000","last_undegraded":"2024-05-08T10:23:47.430150+0000","last_fullsized":"2024-05-08T10:23:47.430150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432262+0000","last_change":"2024-05-08T10:23:47.432262+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432262+0000","last_undegraded":"2024-05-08T10:23:47.432262+0000","last_fullsized":"2024-05-08T10:23:47.432262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426116+0000","last_change":"2024-05-08T10:23:47.426116+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426116+0000","last_undegraded":"2024-05-08T10:23:47.426116+0000","last_fullsized":"2024-05-08T10:23:47.426116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430285+0000","last_change":"2024-05-08T10:23:47.430285+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430285+0000","last_undegraded":"2024-05-08T10:23:47.430285+0000","last_fullsized":"2024-05-08T10:23:47.430285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426086+0000","last_change":"2024-05-08T10:23:47.426086+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426086+0000","last_undegraded":"2024-05-08T10:23:47.426086+0000","last_fullsized":"2024-05-08T10:23:47.426086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426748+0000","last_change":"2024-05-08T10:23:47.426748+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426748+0000","last_undegraded":"2024-05-08T10:23:47.426748+0000","last_fullsized":"2024-05-08T10:23:47.426748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431014+0000","last_change":"2024-05-08T10:23:47.431014+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431014+0000","last_undegraded":"2024-05-08T10:23:47.431014+0000","last_fullsized":"2024-05-08T10:23:47.431014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426126+0000","last_change":"2024-05-08T10:23:47.426126+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426126+0000","last_undegraded":"2024-05-08T10:23:47.426126+0000","last_fullsized":"2024-05-08T10:23:47.426126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429756+0000","last_change":"2024-05-08T10:23:47.429756+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429756+0000","last_undegraded":"2024-05-08T10:23:47.429756+0000","last_fullsized":"2024-05-08T10:23:47.429756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431739+0000","last_change":"2024-05-08T10:23:47.431739+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431739+0000","last_undegraded":"2024-05-08T10:23:47.431739+0000","last_fullsized":"2024-05-08T10:23:47.431739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423041+0000","last_change":"2024-05-08T10:23:47.423041+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423041+0000","last_undegraded":"2024-05-08T10:23:47.423041+0000","last_fullsized":"2024-05-08T10:23:47.423041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428027+0000","last_change":"2024-05-08T10:23:47.428027+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428027+0000","last_undegraded":"2024-05-08T10:23:47.428027+0000","last_fullsized":"2024-05-08T10:23:47.428027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423709+0000","last_change":"2024-05-08T10:23:47.423709+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423709+0000","last_undegraded":"2024-05-08T10:23:47.423709+0000","last_fullsized":"2024-05-08T10:23:47.423709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443494+0000","last_change":"2024-05-08T10:23:47.440565+0000","last_active":"2024-05-08T10:23:47.443494+0000","last_peered":"2024-05-08T10:23:47.443494+0000","last_clean":"2024-05-08T10:23:47.443494+0000","last_became_active":"2024-05-08T10:23:47.440296+0000","last_became_peered":"2024-05-08T10:23:47.440296+0000","last_unstale":"2024-05-08T10:23:47.443494+0000","last_undegraded":"2024-05-08T10:23:47.443494+0000","last_fullsized":"2024-05-08T10:23:47.443494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429282+0000","last_change":"2024-05-08T10:23:47.429282+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429282+0000","last_undegraded":"2024-05-08T10:23:47.429282+0000","last_fullsized":"2024-05-08T10:23:47.429282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.435127+0000","last_change":"2024-05-08T10:23:47.432111+0000","last_active":"2024-05-08T10:23:47.435127+0000","last_peered":"2024-05-08T10:23:47.435127+0000","last_clean":"2024-05-08T10:23:47.435127+0000","last_became_active":"2024-05-08T10:23:47.430756+0000","last_became_peered":"2024-05-08T10:23:47.430756+0000","last_unstale":"2024-05-08T10:23:47.435127+0000","last_undegraded":"2024-05-08T10:23:47.435127+0000","last_fullsized":"2024-05-08T10:23:47.435127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.437909+0000","last_change":"2024-05-08T10:23:47.431893+0000","last_active":"2024-05-08T10:23:47.437909+0000","last_peered":"2024-05-08T10:23:47.437909+0000","last_clean":"2024-05-08T10:23:47.437909+0000","last_became_active":"2024-05-08T10:23:47.431613+0000","last_became_peered":"2024-05-08T10:23:47.431613+0000","last_unstale":"2024-05-08T10:23:47.437909+0000","last_undegraded":"2024-05-08T10:23:47.437909+0000","last_fullsized":"2024-05-08T10:23:47.437909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425824+0000","last_change":"2024-05-08T10:23:47.425824+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425824+0000","last_undegraded":"2024-05-08T10:23:47.425824+0000","last_fullsized":"2024-05-08T10:23:47.425824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.438599+0000","last_change":"2024-05-08T10:23:47.436762+0000","last_active":"2024-05-08T10:23:47.438599+0000","last_peered":"2024-05-08T10:23:47.438599+0000","last_clean":"2024-05-08T10:23:47.438599+0000","last_became_active":"2024-05-08T10:23:47.436442+0000","last_became_peered":"2024-05-08T10:23:47.436442+0000","last_unstale":"2024-05-08T10:23:47.438599+0000","last_undegraded":"2024-05-08T10:23:47.438599+0000","last_fullsized":"2024-05-08T10:23:47.438599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432795+0000","last_change":"2024-05-08T10:23:47.432795+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432795+0000","last_undegraded":"2024-05-08T10:23:47.432795+0000","last_fullsized":"2024-05-08T10:23:47.432795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440383+0000","last_change":"2024-05-08T10:23:47.439183+0000","last_active":"2024-05-08T10:23:47.440383+0000","last_peered":"2024-05-08T10:23:47.440383+0000","last_clean":"2024-05-08T10:23:47.440383+0000","last_became_active":"2024-05-08T10:23:47.438842+0000","last_became_peered":"2024-05-08T10:23:47.438842+0000","last_unstale":"2024-05-08T10:23:47.440383+0000","last_undegraded":"2024-05-08T10:23:47.440383+0000","last_fullsized":"2024-05-08T10:23:47.440383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432457+0000","last_change":"2024-05-08T10:23:47.432457+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432457+0000","last_undegraded":"2024-05-08T10:23:47.432457+0000","last_fullsized":"2024-05-08T10:23:47.432457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447345+0000","last_change":"2024-05-08T10:23:47.442360+0000","last_active":"2024-05-08T10:23:47.447345+0000","last_peered":"2024-05-08T10:23:47.447345+0000","last_clean":"2024-05-08T10:23:47.447345+0000","last_became_active":"2024-05-08T10:23:47.442107+0000","last_became_peered":"2024-05-08T10:23:47.442107+0000","last_unstale":"2024-05-08T10:23:47.447345+0000","last_undegraded":"2024-05-08T10:23:47.447345+0000","last_fullsized":"2024-05-08T10:23:47.447345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429162+0000","last_change":"2024-05-08T10:23:47.429162+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429162+0000","last_undegraded":"2024-05-08T10:23:47.429162+0000","last_fullsized":"2024-05-08T10:23:47.429162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440894+0000","last_change":"2024-05-08T10:23:47.438561+0000","last_active":"2024-05-08T10:23:47.440894+0000","last_peered":"2024-05-08T10:23:47.440894+0000","last_clean":"2024-05-08T10:23:47.440894+0000","last_became_active":"2024-05-08T10:23:47.437710+0000","last_became_peered":"2024-05-08T10:23:47.437710+0000","last_unstale":"2024-05-08T10:23:47.440894+0000","last_undegraded":"2024-05-08T10:23:47.440894+0000","last_fullsized":"2024-05-08T10:23:47.440894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.424002+0000","last_change":"2024-05-08T10:23:47.424002+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.424002+0000","last_undegraded":"2024-05-08T10:23:47.424002+0000","last_fullsized":"2024-05-08T10:23:47.424002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440316+0000","last_change":"2024-05-08T10:23:47.436584+0000","last_active":"2024-05-08T10:23:47.440316+0000","last_peered":"2024-05-08T10:23:47.440316+0000","last_clean":"2024-05-08T10:23:47.440316+0000","last_became_active":"2024-05-08T10:23:47.436126+0000","last_became_peered":"2024-05-08T10:23:47.436126+0000","last_unstale":"2024-05-08T10:23:47.440316+0000","last_undegraded":"2024-05-08T10:23:47.440316+0000","last_fullsized":"2024-05-08T10:23:47.440316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433327+0000","last_change":"2024-05-08T10:23:47.433327+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433327+0000","last_undegraded":"2024-05-08T10:23:47.433327+0000","last_fullsized":"2024-05-08T10:23:47.433327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440924+0000","last_change":"2024-05-08T10:23:47.435055+0000","last_active":"2024-05-08T10:23:47.440924+0000","last_peered":"2024-05-08T10:23:47.440924+0000","last_clean":"2024-05-08T10:23:47.440924+0000","last_became_active":"2024-05-08T10:23:47.434642+0000","last_became_peered":"2024-05-08T10:23:47.434642+0000","last_unstale":"2024-05-08T10:23:47.440924+0000","last_undegraded":"2024-05-08T10:23:47.440924+0000","last_fullsized":"2024-05-08T10:23:47.440924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:52.768923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427182+0000","last_change":"2024-05-08T10:23:47.427182+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427182+0000","last_undegraded":"2024-05-08T10:23:47.427182+0000","last_fullsized":"2024-05-08T10:23:47.427182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440954+0000","last_change":"2024-05-08T10:23:47.437417+0000","last_active":"2024-05-08T10:23:47.440954+0000","last_peered":"2024-05-08T10:23:47.440954+0000","last_clean":"2024-05-08T10:23:47.440954+0000","last_became_active":"2024-05-08T10:23:47.437129+0000","last_became_peered":"2024-05-08T10:23:47.437129+0000","last_unstale":"2024-05-08T10:23:47.440954+0000","last_undegraded":"2024-05-08T10:23:47.440954+0000","last_fullsized":"2024-05-08T10:23:47.440954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.434415+0000","last_change":"2024-05-08T10:23:47.434415+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.434415+0000","last_undegraded":"2024-05-08T10:23:47.434415+0000","last_fullsized":"2024-05-08T10:23:47.434415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.439691+0000","last_change":"2024-05-08T10:23:47.432460+0000","last_active":"2024-05-08T10:23:47.439691+0000","last_peered":"2024-05-08T10:23:47.439691+0000","last_clean":"2024-05-08T10:23:47.439691+0000","last_became_active":"2024-05-08T10:23:47.432156+0000","last_became_peered":"2024-05-08T10:23:47.432156+0000","last_unstale":"2024-05-08T10:23:47.439691+0000","last_undegraded":"2024-05-08T10:23:47.439691+0000","last_fullsized":"2024-05-08T10:23:47.439691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426210+0000","last_change":"2024-05-08T10:23:47.426210+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426210+0000","last_undegraded":"2024-05-08T10:23:47.426210+0000","last_fullsized":"2024-05-08T10:23:47.426210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443217+0000","last_change":"2024-05-08T10:23:47.439271+0000","last_active":"2024-05-08T10:23:47.443217+0000","last_peered":"2024-05-08T10:23:47.443217+0000","last_clean":"2024-05-08T10:23:47.443217+0000","last_became_active":"2024-05-08T10:23:47.438952+0000","last_became_peered":"2024-05-08T10:23:47.438952+0000","last_unstale":"2024-05-08T10:23:47.443217+0000","last_undegraded":"2024-05-08T10:23:47.443217+0000","last_fullsized":"2024-05-08T10:23:47.443217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431177+0000","last_change":"2024-05-08T10:23:47.431177+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431177+0000","last_undegraded":"2024-05-08T10:23:47.431177+0000","last_fullsized":"2024-05-08T10:23:47.431177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.439100+0000","last_change":"2024-05-08T10:23:47.436054+0000","last_active":"2024-05-08T10:23:47.439100+0000","last_peered":"2024-05-08T10:23:47.439100+0000","last_clean":"2024-05-08T10:23:47.439100+0000","last_became_active":"2024-05-08T10:23:47.435777+0000","last_became_peered":"2024-05-08T10:23:47.435777+0000","last_unstale":"2024-05-08T10:23:47.439100+0000","last_undegraded":"2024-05-08T10:23:47.439100+0000","last_fullsized":"2024-05-08T10:23:47.439100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433200+0000","last_change":"2024-05-08T10:23:47.433200+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433200+0000","last_undegraded":"2024-05-08T10:23:47.433200+0000","last_fullsized":"2024-05-08T10:23:47.433200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.434894+0000","last_change":"2024-05-08T10:23:47.428146+0000","last_active":"2024-05-08T10:23:47.434894+0000","last_peered":"2024-05-08T10:23:47.434894+0000","last_clean":"2024-05-08T10:23:47.434894+0000","last_became_active":"2024-05-08T10:23:47.427826+0000","last_became_peered":"2024-05-08T10:23:47.427826+0000","last_unstale":"2024-05-08T10:23:47.434894+0000","last_undegraded":"2024-05-08T10:23:47.434894+0000","last_fullsized":"2024-05-08T10:23:47.434894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430538+0000","last_change":"2024-05-08T10:23:47.430538+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430538+0000","last_undegraded":"2024-05-08T10:23:47.430538+0000","last_fullsized":"2024-05-08T10:23:47.430538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440876+0000","last_change":"2024-05-08T10:23:47.438474+0000","last_active":"2024-05-08T10:23:47.440876+0000","last_peered":"2024-05-08T10:23:47.440876+0000","last_clean":"2024-05-08T10:23:47.440876+0000","last_became_active":"2024-05-08T10:23:47.437999+0000","last_became_peered":"2024-05-08T10:23:47.437999+0000","last_unstale":"2024-05-08T10:23:47.440876+0000","last_undegraded":"2024-05-08T10:23:47.440876+0000","last_fullsized":"2024-05-08T10:23:47.440876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428870+0000","last_change":"2024-05-08T10:23:47.428870+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428870+0000","last_undegraded":"2024-05-08T10:23:47.428870+0000","last_fullsized":"2024-05-08T10:23:47.428870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440677+0000","last_change":"2024-05-08T10:23:47.437314+0000","last_active":"2024-05-08T10:23:47.440677+0000","last_peered":"2024-05-08T10:23:47.440677+0000","last_clean":"2024-05-08T10:23:47.440677+0000","last_became_active":"2024-05-08T10:23:47.436966+0000","last_became_peered":"2024-05-08T10:23:47.436966+0000","last_unstale":"2024-05-08T10:23:47.440677+0000","last_undegraded":"2024-05-08T10:23:47.440677+0000","last_fullsized":"2024-05-08T10:23:47.440677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432723+0000","last_change":"2024-05-08T10:23:47.432723+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432723+0000","last_undegraded":"2024-05-08T10:23:47.432723+0000","last_fullsized":"2024-05-08T10:23:47.432723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.433995+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:23:47.433995+0000","last_peered":"2024-05-08T10:23:47.433995+0000","last_clean":"2024-05-08T10:23:47.433995+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:23:47.433995+0000","last_undegraded":"2024-05-08T10:23:47.433995+0000","last_fullsized":"2024-05-08T10:23:47.433995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.441755+0000","last_change":"2024-05-08T10:23:47.437924+0000","last_active":"2024-05-08T10:23:47.441755+0000","last_peered":"2024-05-08T10:23:47.441755+0000","last_clean":"2024-05-08T10:23:47.441755+0000","last_became_active":"2024-05-08T10:23:47.437630+0000","last_became_peered":"2024-05-08T10:23:47.437630+0000","last_unstale":"2024-05-08T10:23:47.441755+0000","last_undegraded":"2024-05-08T10:23:47.441755+0000","last_fullsized":"2024-05-08T10:23:47.441755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425302+0000","last_change":"2024-05-08T10:23:47.425302+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425302+0000","last_undegraded":"2024-05-08T10:23:47.425302+0000","last_fullsized":"2024-05-08T10:23:47.425302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447365+0000","last_change":"2024-05-08T10:23:47.442183+0000","last_active":"2024-05-08T10:23:47.447365+0000","last_peered":"2024-05-08T10:23:47.447365+0000","last_clean":"2024-05-08T10:23:47.447365+0000","last_became_active":"2024-05-08T10:23:47.441485+0000","last_became_peered":"2024-05-08T10:23:47.441485+0000","last_unstale":"2024-05-08T10:23:47.447365+0000","last_undegraded":"2024-05-08T10:23:47.447365+0000","last_fullsized":"2024-05-08T10:23:47.447365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427767+0000","last_change":"2024-05-08T10:23:47.427767+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427767+0000","last_undegraded":"2024-05-08T10:23:47.427767+0000","last_fullsized":"2024-05-08T10:23:47.427767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.434821+0000","last_change":"2024-05-08T10:23:47.426677+0000","last_active":"2024-05-08T10:23:47.434821+0000","last_peered":"2024-05-08T10:23:47.434821+0000","last_clean":"2024-05-08T10:23:47.434821+0000","last_became_active":"2024-05-08T10:23:47.426406+0000","last_became_peered":"2024-05-08T10:23:47.426406+0000","last_unstale":"2024-05-08T10:23:47.434821+0000","last_undegraded":"2024-05-08T10:23:47.434821+0000","last_fullsized":"2024-05-08T10:23:47.434821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431667+0000","last_change":"2024-05-08T10:23:47.431667+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431667+0000","last_undegraded":"2024-05-08T10:23:47.431667+0000","last_fullsized":"2024-05-08T10:23:47.431667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.444562+0000","last_change":"2024-05-08T10:23:47.440567+0000","last_active":"2024-05-08T10:23:47.444562+0000","last_peered":"2024-05-08T10:23:47.444562+0000","last_clean":"2024-05-08T10:23:47.444562+0000","last_became_active":"2024-05-08T10:23:47.440075+0000","last_became_peered":"2024-05-08T10:23:47.440075+0000","last_unstale":"2024-05-08T10:23:47.444562+0000","last_undegraded":"2024-05-08T10:23:47.444562+0000","last_fullsized":"2024-05-08T10:23:47.444562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423790+0000","last_change":"2024-05-08T10:23:47.423790+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423790+0000","last_undegraded":"2024-05-08T10:23:47.423790+0000","last_fullsized":"2024-05-08T10:23:47.423790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440915+0000","last_change":"2024-05-08T10:23:47.439238+0000","last_active":"2024-05-08T10:23:47.440915+0000","last_peered":"2024-05-08T10:23:47.440915+0000","last_clean":"2024-05-08T10:23:47.440915+0000","last_became_active":"2024-05-08T10:23:47.438965+0000","last_became_peered":"2024-05-08T10:23:47.438965+0000","last_unstale":"2024-05-08T10:23:47.440915+0000","last_undegraded":"2024-05-08T10:23:47.440915+0000","last_fullsized":"2024-05-08T10:23:47.440915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426981+0000","last_change":"2024-05-08T10:23:47.426981+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426981+0000","last_undegraded":"2024-05-08T10:23:47.426981+0000","last_fullsized":"2024-05-08T10:23:47.426981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447420+0000","last_change":"2024-05-08T10:23:47.443886+0000","last_active":"2024-05-08T10:23:47.447420+0000","last_peered":"2024-05-08T10:23:47.447420+0000","last_clean":"2024-05-08T10:23:47.447420+0000","last_became_active":"2024-05-08T10:23:47.443654+0000","last_became_peered":"2024-05-08T10:23:47.443654+0000","last_unstale":"2024-05-08T10:23:47.447420+0000","last_undegraded":"2024-05-08T10:23:47.447420+0000","last_fullsized":"2024-05-08T10:23:47.447420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430356+0000","last_change":"2024-05-08T10:23:47.430356+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430356+0000","last_undegraded":"2024-05-08T10:23:47.430356+0000","last_fullsized":"2024-05-08T10:23:47.430356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443418+0000","last_change":"2024-05-08T10:23:47.440367+0000","last_active":"2024-05-08T10:23:47.443418+0000","last_peered":"2024-05-08T10:23:47.443418+0000","last_clean":"2024-05-08T10:23:47.443418+0000","last_became_active":"2024-05-08T10:23:47.440098+0000","last_became_peered":"2024-05-08T10:23:47.440098+0000","last_unstale":"2024-05-08T10:23:47.443418+0000","last_undegraded":"2024-05-08T10:23:47.443418+0000","last_fullsized":"2024-05-08T10:23:47.443418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425319+0000","last_change":"2024-05-08T10:23:47.425319+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425319+0000","last_undegraded":"2024-05-08T10:23:47.425319+0000","last_fullsized":"2024-05-08T10:23:47.425319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447250+0000","last_change":"2024-05-08T10:23:47.441809+0000","last_active":"2024-05-08T10:23:47.447250+0000","last_peered":"2024-05-08T10:23:47.447250+0000","last_clean":"2024-05-08T10:23:47.447250+0000","last_became_active":"2024-05-08T10:23:47.441527+0000","last_became_peered":"2024-05-08T10:23:47.441527+0000","last_unstale":"2024-05-08T10:23:47.447250+0000","last_undegraded":"2024-05-08T10:23:47.447250+0000","last_fullsized":"2024-05-08T10:23:47.447250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428062+0000","last_change":"2024-05-08T10:23:47.428062+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428062+0000","last_undegraded":"2024-05-08T10:23:47.428062+0000","last_fullsized":"2024-05-08T10:23:47.428062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447416+0000","last_change":"2024-05-08T10:23:47.443969+0000","last_active":"2024-05-08T10:23:47.447416+0000","last_peered":"2024-05-08T10:23:47.447416+0000","last_clean":"2024-05-08T10:23:47.447416+0000","last_became_active":"2024-05-08T10:23:47.443699+0000","last_became_peered":"2024-05-08T10:23:47.443699+0000","last_unstale":"2024-05-08T10:23:47.447416+0000","last_undegraded":"2024-05-08T10:23:47.447416+0000","last_fullsized":"2024-05-08T10:23:47.447416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423866+0000","last_change":"2024-05-08T10:23:47.423866+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423866+0000","last_undegraded":"2024-05-08T10:23:47.423866+0000","last_fullsized":"2024-05-08T10:23:47.423866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443627+0000","last_change":"2024-05-08T10:23:47.441563+0000","last_active":"2024-05-08T10:23:47.443627+0000","last_peered":"2024-05-08T10:23:47.443627+0000","last_clean":"2024-05-08T10:23:47.443627+0000","last_became_active":"2024-05-08T10:23:47.441300+0000","last_became_peered":"2024-05-08T10:23:47.441300+0000","last_unstale":"2024-05-08T10:23:47.443627+0000","last_undegraded":"2024-05-08T10:23:47.443627+0000","last_fullsized":"2024-05-08T10:23:47.443627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425290+0000","last_change":"2024-05-08T10:23:47.425290+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425290+0000","last_undegraded":"2024-05-08T10:23:47.425290+0000","last_fullsized":"2024-05-08T10:23:47.425290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440842+0000","last_change":"2024-05-08T10:23:47.438095+0000","last_active":"2024-05-08T10:23:47.440842+0000","last_peered":"2024-05-08T10:23:47.440842+0000","last_clean":"2024-05-08T10:23:47.440842+0000","last_became_active":"2024-05-08T10:23:47.437623+0000","last_became_peered":"2024-05-08T10:23:47.437623+0000","last_unstale":"2024-05-08T10:23:47.440842+0000","last_undegraded":"2024-05-08T10:23:47.440842+0000","last_fullsized":"2024-05-08T10:23:47.440842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425305+0000","last_change":"2024-05-08T10:23:47.425305+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425305+0000","last_undegraded":"2024-05-08T10:23:47.425305+0000","last_fullsized":"2024-05-08T10:23:47.425305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447360+0000","last_change":"2024-05-08T10:23:47.441909+0000","last_active":"2024-05-08T10:23:47.447360+0000","last_peered":"2024-05-08T10:23:47.447360+0000","last_clean":"2024-05-08T10:23:47.447360+0000","last_became_active":"2024-05-08T10:23:47.441503+0000","last_became_peered":"2024-05-08T10:23:47.441503+0000","last_unstale":"2024-05-08T10:23:47.447360+0000","last_undegraded":"2024-05-08T10:23:47.447360+0000","last_fullsized":"2024-05-08T10:23:47.447360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427269+0000","last_change":"2024-05-08T10:23:47.427269+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427269+0000","last_undegraded":"2024-05-08T10:23:47.427269+0000","last_fullsized":"2024-05-08T10:23:47.427269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427572+0000","last_change":"2024-05-08T10:23:47.427572+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427572+0000","last_undegraded":"2024-05-08T10:23:47.427572+0000","last_fullsized":"2024-05-08T10:23:47.427572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.444331+0000","last_change":"2024-05-08T10:23:47.439945+0000","last_active":"2024-05-08T10:23:47.444331+0000","last_peered":"2024-05-08T10:23:47.444331+0000","last_clean":"2024-05-08T10:23:47.444331+0000","last_became_active":"2024-05-08T10:23:47.439631+0000","last_became_peered":"2024-05-08T10:23:47.439631+0000","last_unstale":"2024-05-08T10:23:47.444331+0000","last_undegraded":"2024-05-08T10:23:47.444331+0000","last_fullsized":"2024-05-08T10:23:47.444331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429334+0000","last_change":"2024-05-08T10:23:47.429334+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429334+0000","last_undegraded":"2024-05-08T10:23:47.429334+0000","last_fullsized":"2024-05-08T10:23:47.429334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447396+0000","last_change":"2024-05-08T10:23:47.442600+0000","last_active":"2024-05-08T10:23:47.447396+0000","last_peered":"2024-05-08T10:23:47.447396+0000","last_clean":"2024-05-08T10:23:47.447396+0000","last_became_active":"2024-05-08T10:23:47.441385+0000","last_became_peered":"2024-05-08T10:23:47.441385+0000","last_unstale":"2024-05-08T10:23:47.447396+0000","last_undegraded":"2024-05-08T10:23:47.447396+0000","last_fullsized":"2024-05-08T10:23:47.447396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429673+0000","last_change":"2024-05-08T10:23:47.429673+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429673+0000","last_undegraded":"2024-05-08T10:23:47.429673+0000","last_fullsized":"2024-05-08T10:23:47.429673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.438367+0000","last_change":"2024-05-08T10:23:47.435845+0000","last_active":"2024-05-08T10:23:47.438367+0000","last_peered":"2024-05-08T10:23:47.438367+0000","last_clean":"2024-05-08T10:23:47.438367+0000","last_became_active":"2024-05-08T10:23:47.435557+0000","last_became_peered":"2024-05-08T10:23:47.435557+0000","last_unstale":"2024-05-08T10:23:47.438367+0000","last_undegraded":"2024-05-08T10:23:47.438367+0000","last_fullsized":"2024-05-08T10:23:47.438367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425885+0000","last_change":"2024-05-08T10:23:47.425885+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425885+0000","last_undegraded":"2024-05-08T10:23:47.425885+0000","last_fullsized":"2024-05-08T10:23:47.425885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443369+0000","last_change":"2024-05-08T10:23:47.439956+0000","last_active":"2024-05-08T10:23:47.443369+0000","last_peered":"2024-05-08T10:23:47.443369+0000","last_clean":"2024-05-08T10:23:47.443369+0000","last_became_active":"2024-05-08T10:23:47.439661+0000","last_became_peered":"2024-05-08T10:23:47.439661+0000","last_unstale":"2024-05-08T10:23:47.443369+0000","last_undegraded":"2024-05-08T10:23:47.443369+0000","last_fullsized":"2024-05-08T10:23:47.443369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":774144,"data_stored":648227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:23:51.410 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:23:51.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.557+0000 7fe8a21c1640 1 Processor -- start 2024-05-08T10:23:51.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.557+0000 7fe8a21c1640 1 -- start start 2024-05-08T10:23:51.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe8a21c1640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe89c142390 0x7fe89c0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe8a21c1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe89c142770 con 0x7fe89c0b65e0 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe8a21c1640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe89c163d30 con 0x7fe89c1636d0 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe8a21c1640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe89c163b00 con 0x7fe89c142390 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89affd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe89c0b65e0 0x7fe89c162fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54244/0 (socket says 172.21.15.143:54244) 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89affd640 1 -- 172.21.15.143:0/226164835 learned_addr learned my addr 172.21.15.143:0/226164835 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389695619 0 0) 0x7fe89c142770 con 0x7fe89c0b65e0 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89b7fe640 1 --2- 172.21.15.143:0/226164835 >> v2:172.21.15.163:3300/0 conn(0x7fe89c142390 0x7fe89c0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe884003520 con 0x7fe89c0b65e0 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3452370920 0 0) 0x7fe884003520 con 0x7fe89c0b65e0 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 >> v2:172.21.15.163:3300/0 conn(0x7fe89c142390 msgr2=0x7fe89c0b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 --2- 172.21.15.143:0/226164835 >> v2:172.21.15.163:3300/0 conn(0x7fe89c142390 0x7fe89c0b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 >> v1:172.21.15.163:6789/0 conn(0x7fe89c1636d0 legacy=0x7fe89c142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c15f990 con 0x7fe89c0b65e0 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7fe890001a70 con 0x7fe89c0b65e0 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 >> v1:172.21.15.143:6789/0 conn(0x7fe89c0b65e0 legacy=0x7fe89c162fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe884003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.558+0000 7fe89a7fc640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89a7fc640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8840051c0 0x7fe88400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe88400c130 con 0x7fe884003a50 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe88400c2e0 con 0x7fe8840051c0 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe88400c4e0 con 0x7fe884004800 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89b7fe640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe884003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89affd640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89bfff640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8840051c0 0x7fe88400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89b7fe640 1 -- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe884004800 msgr2=0x7fe884004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:51.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89b7fe640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89b7fe640 1 -- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8840051c0 msgr2=0x7fe88400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89b7fe640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8840051c0 0x7fe88400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89b7fe640 1 -- 172.21.15.143:0/226164835 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe884003520 con 0x7fe884003a50 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89bfff640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8840051c0 0x7fe88400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89affd640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89bfff640 1 -- 172.21.15.143:0/226164835 reap_dead start 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.559+0000 7fe89b7fe640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe884003e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009ac0 tx=0x7fe884005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f528d12ac262e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c036070 con 0x7fe884003a50 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88c031400 con 0x7fe884003a50 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe89a7fc640 1 -- 172.21.15.143:0/226164835 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c009690 con 0x7fe884003a50 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe8a21c1640 1 -- 172.21.15.143:0/226164835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 msgr2=0x7fe884003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe8a21c1640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe884003e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009ac0 tx=0x7fe884005830 comp rx=0 tx=0).stop 2024-05-08T10:23:51.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe8a21c1640 1 -- 172.21.15.143:0/226164835 shutdown_connections 2024-05-08T10:23:51.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe8a21c1640 1 --2- 172.21.15.143:0/226164835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe884003e70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe8a21c1640 1 -- 172.21.15.143:0/226164835 >> 172.21.15.143:0/226164835 conn(0x7fe89c0b4da0 msgr2=0x7fe89c0b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:51.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe8a21c1640 1 -- 172.21.15.143:0/226164835 shutdown_connections 2024-05-08T10:23:51.550 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.560+0000 7fe8a21c1640 1 -- 172.21.15.143:0/226164835 wait complete. 2024-05-08T10:23:51.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.561+0000 7fe8a21c1640 1 Processor -- start 2024-05-08T10:23:51.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe8a21c1640 1 -- start start 2024-05-08T10:23:51.552 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe8a21c1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe89c161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe8a21c1640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe89c1407d0 0x7fe89c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe8a21c1640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe89c144710 0x7fe89c144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe8a21c1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c160230 con 0x7fe884003a50 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe8a21c1640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c15ff50 con 0x7fe89c144710 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe8a21c1640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe89c160750 con 0x7fe89c1407d0 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe89c161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe89c161a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58764/0 (socket says 172.21.15.143:58764) 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe89b7fe640 1 -- 172.21.15.143:0/1043096376 learned_addr learned my addr 172.21.15.143:0/1043096376 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.562+0000 7fe89b7fe640 1 -- 172.21.15.143:0/1043096376 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe89c1407d0 msgr2=0x7fe89c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe89b7fe640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe89c1407d0 0x7fe89c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe89b7fe640 1 -- 172.21.15.143:0/1043096376 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe89c144710 msgr2=0x7fe89c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe89b7fe640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe89c144710 0x7fe89c144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.553 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe89b7fe640 1 -- 172.21.15.143:0/1043096376 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c143f50 con 0x7fe884003a50 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe89b7fe640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe89c161a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe88c034040 tx=0x7fe88c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe883fff640 1 -- 172.21.15.143:0/1043096376 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c03f020 con 0x7fe884003a50 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe883fff640 1 -- 172.21.15.143:0/1043096376 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88c037040 con 0x7fe884003a50 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89c162240 con 0x7fe884003a50 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe883fff640 1 -- 172.21.15.143:0/1043096376 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c036070 con 0x7fe884003a50 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.563+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe89c162800 con 0x7fe884003a50 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.564+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe89c075dc0 con 0x7fe884003a50 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.564+0000 7fe883fff640 1 -- 172.21.15.143:0/1043096376 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe88c042020 con 0x7fe884003a50 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.565+0000 7fe883fff640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe8880762d0 0x7fe888078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.565+0000 7fe89affd640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe8880762d0 0x7fe888078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.565+0000 7fe883fff640 1 -- 172.21.15.143:0/1043096376 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe88c0b7600 con 0x7fe884003a50 2024-05-08T10:23:51.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.565+0000 7fe89affd640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe8880762d0 0x7fe888078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8900012e0 tx=0x7fe890001250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:51.555 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.569+0000 7fe883fff640 1 -- 172.21.15.143:0/1043096376 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe88c049030 con 0x7fe884003a50 2024-05-08T10:23:51.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.745+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe89c0b5a40 con 0x7fe8880762d0 2024-05-08T10:23:51.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.750+0000 7fe883fff640 1 -- 172.21.15.143:0/1043096376 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246613 (secure 0 0 0) 0x7fe89c0b5a40 con 0x7fe8880762d0 2024-05-08T10:23:51.739 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:51.741 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:23:51.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe8880762d0 msgr2=0x7fe888078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe8880762d0 0x7fe888078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8900012e0 tx=0x7fe890001250 comp rx=0 tx=0).stop 2024-05-08T10:23:51.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 msgr2=0x7fe89c161a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe89c161a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe88c034040 tx=0x7fe88c004730 comp rx=0 tx=0).stop 2024-05-08T10:23:51.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 shutdown_connections 2024-05-08T10:23:51.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe89c144710 0x7fe89c144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe89c1407d0 0x7fe89c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe8880762d0 0x7fe888078790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 --2- 172.21.15.143:0/1043096376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe884003a50 0x7fe89c161a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 >> 172.21.15.143:0/1043096376 conn(0x7fe89c0b4da0 msgr2=0x7fe89c06eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:51.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 shutdown_connections 2024-05-08T10:23:51.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.754+0000 7fe8a21c1640 1 -- 172.21.15.143:0/1043096376 wait complete. 2024-05-08T10:23:51.751 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-05-08T10:23:50.524933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":2508,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":2568192,"data_stored":1612233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.101000"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431662+0000","last_change":"2024-05-08T10:23:47.431662+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431662+0000","last_undegraded":"2024-05-08T10:23:47.431662+0000","last_fullsized":"2024-05-08T10:23:47.431662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431196+0000","last_change":"2024-05-08T10:23:47.431196+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431196+0000","last_undegraded":"2024-05-08T10:23:47.431196+0000","last_fullsized":"2024-05-08T10:23:47.431196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427104+0000","last_change":"2024-05-08T10:23:47.427104+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427104+0000","last_undegraded":"2024-05-08T10:23:47.427104+0000","last_fullsized":"2024-05-08T10:23:47.427104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429800+0000","last_change":"2024-05-08T10:23:47.429800+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429800+0000","last_undegraded":"2024-05-08T10:23:47.429800+0000","last_fullsized":"2024-05-08T10:23:47.429800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.435270+0000","last_change":"2024-05-08T10:23:47.435270+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.435270+0000","last_undegraded":"2024-05-08T10:23:47.435270+0000","last_fullsized":"2024-05-08T10:23:47.435270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433166+0000","last_change":"2024-05-08T10:23:47.433166+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433166+0000","last_undegraded":"2024-05-08T10:23:47.433166+0000","last_fullsized":"2024-05-08T10:23:47.433166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431815+0000","last_change":"2024-05-08T10:23:47.431815+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431815+0000","last_undegraded":"2024-05-08T10:23:47.431815+0000","last_fullsized":"2024-05-08T10:23:47.431815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426758+0000","last_change":"2024-05-08T10:23:47.426758+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426758+0000","last_undegraded":"2024-05-08T10:23:47.426758+0000","last_fullsized":"2024-05-08T10:23:47.426758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431039+0000","last_change":"2024-05-08T10:23:47.431039+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431039+0000","last_undegraded":"2024-05-08T10:23:47.431039+0000","last_fullsized":"2024-05-08T10:23:47.431039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428458+0000","last_change":"2024-05-08T10:23:47.428458+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428458+0000","last_undegraded":"2024-05-08T10:23:47.428458+0000","last_fullsized":"2024-05-08T10:23:47.428458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426526+0000","last_change":"2024-05-08T10:23:47.426526+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426526+0000","last_undegraded":"2024-05-08T10:23:47.426526+0000","last_fullsized":"2024-05-08T10:23:47.426526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425230+0000","last_change":"2024-05-08T10:23:47.425230+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425230+0000","last_undegraded":"2024-05-08T10:23:47.425230+0000","last_fullsized":"2024-05-08T10:23:47.425230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426133+0000","last_change":"2024-05-08T10:23:47.426133+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426133+0000","last_undegraded":"2024-05-08T10:23:47.426133+0000","last_fullsized":"2024-05-08T10:23:47.426133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429210+0000","last_change":"2024-05-08T10:23:47.429210+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429210+0000","last_undegraded":"2024-05-08T10:23:47.429210+0000","last_fullsized":"2024-05-08T10:23:47.429210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431289+0000","last_change":"2024-05-08T10:23:47.431289+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431289+0000","last_undegraded":"2024-05-08T10:23:47.431289+0000","last_fullsized":"2024-05-08T10:23:47.431289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430746+0000","last_change":"2024-05-08T10:23:47.430746+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430746+0000","last_undegraded":"2024-05-08T10:23:47.430746+0000","last_fullsized":"2024-05-08T10:23:47.430746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426764+0000","last_change":"2024-05-08T10:23:47.426764+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426764+0000","last_undegraded":"2024-05-08T10:23:47.426764+0000","last_fullsized":"2024-05-08T10:23:47.426764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.422801+0000","last_change":"2024-05-08T10:23:47.422801+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.422801+0000","last_undegraded":"2024-05-08T10:23:47.422801+0000","last_fullsized":"2024-05-08T10:23:47.422801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430500+0000","last_change":"2024-05-08T10:23:47.430500+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430500+0000","last_undegraded":"2024-05-08T10:23:47.430500+0000","last_fullsized":"2024-05-08T10:23:47.430500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426934+0000","last_change":"2024-05-08T10:23:47.426934+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426934+0000","last_undegraded":"2024-05-08T10:23:47.426934+0000","last_fullsized":"2024-05-08T10:23:47.426934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430150+0000","last_change":"2024-05-08T10:23:47.430150+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430150+0000","last_undegraded":"2024-05-08T10:23:47.430150+0000","last_fullsized":"2024-05-08T10:23:47.430150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432262+0000","last_change":"2024-05-08T10:23:47.432262+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432262+0000","last_undegraded":"2024-05-08T10:23:47.432262+0000","last_fullsized":"2024-05-08T10:23:47.432262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426116+0000","last_change":"2024-05-08T10:23:47.426116+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426116+0000","last_undegraded":"2024-05-08T10:23:47.426116+0000","last_fullsized":"2024-05-08T10:23:47.426116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430285+0000","last_change":"2024-05-08T10:23:47.430285+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430285+0000","last_undegraded":"2024-05-08T10:23:47.430285+0000","last_fullsized":"2024-05-08T10:23:47.430285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426086+0000","last_change":"2024-05-08T10:23:47.426086+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426086+0000","last_undegraded":"2024-05-08T10:23:47.426086+0000","last_fullsized":"2024-05-08T10:23:47.426086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426748+0000","last_change":"2024-05-08T10:23:47.426748+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426748+0000","last_undegraded":"2024-05-08T10:23:47.426748+0000","last_fullsized":"2024-05-08T10:23:47.426748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431014+0000","last_change":"2024-05-08T10:23:47.431014+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431014+0000","last_undegraded":"2024-05-08T10:23:47.431014+0000","last_fullsized":"2024-05-08T10:23:47.431014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426126+0000","last_change":"2024-05-08T10:23:47.426126+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426126+0000","last_undegraded":"2024-05-08T10:23:47.426126+0000","last_fullsized":"2024-05-08T10:23:47.426126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429756+0000","last_change":"2024-05-08T10:23:47.429756+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429756+0000","last_undegraded":"2024-05-08T10:23:47.429756+0000","last_fullsized":"2024-05-08T10:23:47.429756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431739+0000","last_change":"2024-05-08T10:23:47.431739+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431739+0000","last_undegraded":"2024-05-08T10:23:47.431739+0000","last_fullsized":"2024-05-08T10:23:47.431739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423041+0000","last_change":"2024-05-08T10:23:47.423041+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423041+0000","last_undegraded":"2024-05-08T10:23:47.423041+0000","last_fullsized":"2024-05-08T10:23:47.423041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428027+0000","last_change":"2024-05-08T10:23:47.428027+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428027+0000","last_undegraded":"2024-05-08T10:23:47.428027+0000","last_fullsized":"2024-05-08T10:23:47.428027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423709+0000","last_change":"2024-05-08T10:23:47.423709+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423709+0000","last_undegraded":"2024-05-08T10:23:47.423709+0000","last_fullsized":"2024-05-08T10:23:47.423709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443494+0000","last_change":"2024-05-08T10:23:47.440565+0000","last_active":"2024-05-08T10:23:47.443494+0000","last_peered":"2024-05-08T10:23:47.443494+0000","last_clean":"2024-05-08T10:23:47.443494+0000","last_became_active":"2024-05-08T10:23:47.440296+0000","last_became_peered":"2024-05-08T10:23:47.440296+0000","last_unstale":"2024-05-08T10:23:47.443494+0000","last_undegraded":"2024-05-08T10:23:47.443494+0000","last_fullsized":"2024-05-08T10:23:47.443494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429282+0000","last_change":"2024-05-08T10:23:47.429282+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429282+0000","last_undegraded":"2024-05-08T10:23:47.429282+0000","last_fullsized":"2024-05-08T10:23:47.429282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.435127+0000","last_change":"2024-05-08T10:23:47.432111+0000","last_active":"2024-05-08T10:23:47.435127+0000","last_peered":"2024-05-08T10:23:47.435127+0000","last_clean":"2024-05-08T10:23:47.435127+0000","last_became_active":"2024-05-08T10:23:47.430756+0000","last_became_peered":"2024-05-08T10:23:47.430756+0000","last_unstale":"2024-05-08T10:23:47.435127+0000","last_undegraded":"2024-05-08T10:23:47.435127+0000","last_fullsized":"2024-05-08T10:23:47.435127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.437909+0000","last_change":"2024-05-08T10:23:47.431893+0000","last_active":"2024-05-08T10:23:47.437909+0000","last_peered":"2024-05-08T10:23:47.437909+0000","last_clean":"2024-05-08T10:23:47.437909+0000","last_became_active":"2024-05-08T10:23:47.431613+0000","last_became_peered":"2024-05-08T10:23:47.431613+0000","last_unstale":"2024-05-08T10:23:47.437909+0000","last_undegraded":"2024-05-08T10:23:47.437909+0000","last_fullsized":"2024-05-08T10:23:47.437909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425824+0000","last_change":"2024-05-08T10:23:47.425824+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425824+0000","last_undegraded":"2024-05-08T10:23:47.425824+0000","last_fullsized":"2024-05-08T10:23:47.425824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.438599+0000","last_change":"2024-05-08T10:23:47.436762+0000","last_active":"2024-05-08T10:23:47.438599+0000","last_peered":"2024-05-08T10:23:47.438599+0000","last_clean":"2024-05-08T10:23:47.438599+0000","last_became_active":"2024-05-08T10:23:47.436442+0000","last_became_peered":"2024-05-08T10:23:47.436442+0000","last_unstale":"2024-05-08T10:23:47.438599+0000","last_undegraded":"2024-05-08T10:23:47.438599+0000","last_fullsized":"2024-05-08T10:23:47.438599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432795+0000","last_change":"2024-05-08T10:23:47.432795+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432795+0000","last_undegraded":"2024-05-08T10:23:47.432795+0000","last_fullsized":"2024-05-08T10:23:47.432795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440383+0000","last_change":"2024-05-08T10:23:47.439183+0000","last_active":"2024-05-08T10:23:47.440383+0000","last_peered":"2024-05-08T10:23:47.440383+0000","last_clean":"2024-05-08T10:23:47.440383+0000","last_became_active":"2024-05-08T10:23:47.438842+0000","last_became_peered":"2024-05-08T10:23:47.438842+0000","last_unstale":"2024-05-08T10:23:47.440383+0000","last_undegraded":"2024-05-08T10:23:47.440383+0000","last_fullsized":"2024-05-08T10:23:47.440383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432457+0000","last_change":"2024-05-08T10:23:47.432457+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432457+0000","last_undegraded":"2024-05-08T10:23:47.432457+0000","last_fullsized":"2024-05-08T10:23:47.432457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447345+0000","last_change":"2024-05-08T10:23:47.442360+0000","last_active":"2024-05-08T10:23:47.447345+0000","last_peered":"2024-05-08T10:23:47.447345+0000","last_clean":"2024-05-08T10:23:47.447345+0000","last_became_active":"2024-05-08T10:23:47.442107+0000","last_became_peered":"2024-05-08T10:23:47.442107+0000","last_unstale":"2024-05-08T10:23:47.447345+0000","last_undegraded":"2024-05-08T10:23:47.447345+0000","last_fullsized":"2024-05-08T10:23:47.447345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429162+0000","last_change":"2024-05-08T10:23:47.429162+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429162+0000","last_undegraded":"2024-05-08T10:23:47.429162+0000","last_fullsized":"2024-05-08T10:23:47.429162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440894+0000","last_change":"2024-05-08T10:23:47.438561+0000","last_active":"2024-05-08T10:23:47.440894+0000","last_peered":"2024-05-08T10:23:47.440894+0000","last_clean":"2024-05-08T10:23:47.440894+0000","last_became_active":"2024-05-08T10:23:47.437710+0000","last_became_peered":"2024-05-08T10:23:47.437710+0000","last_unstale":"2024-05-08T10:23:47.440894+0000","last_undegraded":"2024-05-08T10:23:47.440894+0000","last_fullsized":"2024-05-08T10:23:47.440894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.424002+0000","last_change":"2024-05-08T10:23:47.424002+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.424002+0000","last_undegraded":"2024-05-08T10:23:47.424002+0000","last_fullsized":"2024-05-08T10:23:47.424002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440316+0000","last_change":"2024-05-08T10:23:47.436584+0000","last_active":"2024-05-08T10:23:47.440316+0000","last_peered":"2024-05-08T10:23:47.440316+0000","last_clean":"2024-05-08T10:23:47.440316+0000","last_became_active":"2024-05-08T10:23:47.436126+0000","last_became_peered":"2024-05-08T10:23:47.436126+0000","last_unstale":"2024-05-08T10:23:47.440316+0000","last_undegraded":"2024-05-08T10:23:47.440316+0000","last_fullsized":"2024-05-08T10:23:47.440316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433327+0000","last_change":"2024-05-08T10:23:47.433327+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433327+0000","last_undegraded":"2024-05-08T10:23:47.433327+0000","last_fullsized":"2024-05-08T10:23:47.433327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440924+0000","last_change":"2024-05-08T10:23:47.435055+0000","last_active":"2024-05-08T10:23:47.440924+0000","last_peered":"2024-05-08T10:23:47.440924+0000","last_clean":"2024-05-08T10:23:47.440924+0000","last_became_active":"2024-05-08T10:23:47.434642+0000","last_became_peered":"2024-05-08T10:23:47.434642+0000","last_unstale":"2024-05-08T10:23:47.440924+0000","last_undegraded":"2024-05-08T10:23:47.440924+0000","last_fullsized":"2024-05-08T10:23:47.440924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:52.768923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427182+0000","last_change":"2024-05-08T10:23:47.427182+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427182+0000","last_undegraded":"2024-05-08T10:23:47.427182+0000","last_fullsized":"2024-05-08T10:23:47.427182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440954+0000","last_change":"2024-05-08T10:23:47.437417+0000","last_active":"2024-05-08T10:23:47.440954+0000","last_peered":"2024-05-08T10:23:47.440954+0000","last_clean":"2024-05-08T10:23:47.440954+0000","last_became_active":"2024-05-08T10:23:47.437129+0000","last_became_peered":"2024-05-08T10:23:47.437129+0000","last_unstale":"2024-05-08T10:23:47.440954+0000","last_undegraded":"2024-05-08T10:23:47.440954+0000","last_fullsized":"2024-05-08T10:23:47.440954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.434415+0000","last_change":"2024-05-08T10:23:47.434415+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.434415+0000","last_undegraded":"2024-05-08T10:23:47.434415+0000","last_fullsized":"2024-05-08T10:23:47.434415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.439691+0000","last_change":"2024-05-08T10:23:47.432460+0000","last_active":"2024-05-08T10:23:47.439691+0000","last_peered":"2024-05-08T10:23:47.439691+0000","last_clean":"2024-05-08T10:23:47.439691+0000","last_became_active":"2024-05-08T10:23:47.432156+0000","last_became_peered":"2024-05-08T10:23:47.432156+0000","last_unstale":"2024-05-08T10:23:47.439691+0000","last_undegraded":"2024-05-08T10:23:47.439691+0000","last_fullsized":"2024-05-08T10:23:47.439691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426210+0000","last_change":"2024-05-08T10:23:47.426210+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426210+0000","last_undegraded":"2024-05-08T10:23:47.426210+0000","last_fullsized":"2024-05-08T10:23:47.426210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443217+0000","last_change":"2024-05-08T10:23:47.439271+0000","last_active":"2024-05-08T10:23:47.443217+0000","last_peered":"2024-05-08T10:23:47.443217+0000","last_clean":"2024-05-08T10:23:47.443217+0000","last_became_active":"2024-05-08T10:23:47.438952+0000","last_became_peered":"2024-05-08T10:23:47.438952+0000","last_unstale":"2024-05-08T10:23:47.443217+0000","last_undegraded":"2024-05-08T10:23:47.443217+0000","last_fullsized":"2024-05-08T10:23:47.443217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431177+0000","last_change":"2024-05-08T10:23:47.431177+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431177+0000","last_undegraded":"2024-05-08T10:23:47.431177+0000","last_fullsized":"2024-05-08T10:23:47.431177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.439100+0000","last_change":"2024-05-08T10:23:47.436054+0000","last_active":"2024-05-08T10:23:47.439100+0000","last_peered":"2024-05-08T10:23:47.439100+0000","last_clean":"2024-05-08T10:23:47.439100+0000","last_became_active":"2024-05-08T10:23:47.435777+0000","last_became_peered":"2024-05-08T10:23:47.435777+0000","last_unstale":"2024-05-08T10:23:47.439100+0000","last_undegraded":"2024-05-08T10:23:47.439100+0000","last_fullsized":"2024-05-08T10:23:47.439100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433200+0000","last_change":"2024-05-08T10:23:47.433200+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433200+0000","last_undegraded":"2024-05-08T10:23:47.433200+0000","last_fullsized":"2024-05-08T10:23:47.433200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.434894+0000","last_change":"2024-05-08T10:23:47.428146+0000","last_active":"2024-05-08T10:23:47.434894+0000","last_peered":"2024-05-08T10:23:47.434894+0000","last_clean":"2024-05-08T10:23:47.434894+0000","last_became_active":"2024-05-08T10:23:47.427826+0000","last_became_peered":"2024-05-08T10:23:47.427826+0000","last_unstale":"2024-05-08T10:23:47.434894+0000","last_undegraded":"2024-05-08T10:23:47.434894+0000","last_fullsized":"2024-05-08T10:23:47.434894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430538+0000","last_change":"2024-05-08T10:23:47.430538+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430538+0000","last_undegraded":"2024-05-08T10:23:47.430538+0000","last_fullsized":"2024-05-08T10:23:47.430538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440876+0000","last_change":"2024-05-08T10:23:47.438474+0000","last_active":"2024-05-08T10:23:47.440876+0000","last_peered":"2024-05-08T10:23:47.440876+0000","last_clean":"2024-05-08T10:23:47.440876+0000","last_became_active":"2024-05-08T10:23:47.437999+0000","last_became_peered":"2024-05-08T10:23:47.437999+0000","last_unstale":"2024-05-08T10:23:47.440876+0000","last_undegraded":"2024-05-08T10:23:47.440876+0000","last_fullsized":"2024-05-08T10:23:47.440876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428870+0000","last_change":"2024-05-08T10:23:47.428870+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428870+0000","last_undegraded":"2024-05-08T10:23:47.428870+0000","last_fullsized":"2024-05-08T10:23:47.428870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440677+0000","last_change":"2024-05-08T10:23:47.437314+0000","last_active":"2024-05-08T10:23:47.440677+0000","last_peered":"2024-05-08T10:23:47.440677+0000","last_clean":"2024-05-08T10:23:47.440677+0000","last_became_active":"2024-05-08T10:23:47.436966+0000","last_became_peered":"2024-05-08T10:23:47.436966+0000","last_unstale":"2024-05-08T10:23:47.440677+0000","last_undegraded":"2024-05-08T10:23:47.440677+0000","last_fullsized":"2024-05-08T10:23:47.440677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432723+0000","last_change":"2024-05-08T10:23:47.432723+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432723+0000","last_undegraded":"2024-05-08T10:23:47.432723+0000","last_fullsized":"2024-05-08T10:23:47.432723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.433995+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:23:47.433995+0000","last_peered":"2024-05-08T10:23:47.433995+0000","last_clean":"2024-05-08T10:23:47.433995+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:23:47.433995+0000","last_undegraded":"2024-05-08T10:23:47.433995+0000","last_fullsized":"2024-05-08T10:23:47.433995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.441755+0000","last_change":"2024-05-08T10:23:47.437924+0000","last_active":"2024-05-08T10:23:47.441755+0000","last_peered":"2024-05-08T10:23:47.441755+0000","last_clean":"2024-05-08T10:23:47.441755+0000","last_became_active":"2024-05-08T10:23:47.437630+0000","last_became_peered":"2024-05-08T10:23:47.437630+0000","last_unstale":"2024-05-08T10:23:47.441755+0000","last_undegraded":"2024-05-08T10:23:47.441755+0000","last_fullsized":"2024-05-08T10:23:47.441755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425302+0000","last_change":"2024-05-08T10:23:47.425302+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425302+0000","last_undegraded":"2024-05-08T10:23:47.425302+0000","last_fullsized":"2024-05-08T10:23:47.425302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447365+0000","last_change":"2024-05-08T10:23:47.442183+0000","last_active":"2024-05-08T10:23:47.447365+0000","last_peered":"2024-05-08T10:23:47.447365+0000","last_clean":"2024-05-08T10:23:47.447365+0000","last_became_active":"2024-05-08T10:23:47.441485+0000","last_became_peered":"2024-05-08T10:23:47.441485+0000","last_unstale":"2024-05-08T10:23:47.447365+0000","last_undegraded":"2024-05-08T10:23:47.447365+0000","last_fullsized":"2024-05-08T10:23:47.447365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427767+0000","last_change":"2024-05-08T10:23:47.427767+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427767+0000","last_undegraded":"2024-05-08T10:23:47.427767+0000","last_fullsized":"2024-05-08T10:23:47.427767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.434821+0000","last_change":"2024-05-08T10:23:47.426677+0000","last_active":"2024-05-08T10:23:47.434821+0000","last_peered":"2024-05-08T10:23:47.434821+0000","last_clean":"2024-05-08T10:23:47.434821+0000","last_became_active":"2024-05-08T10:23:47.426406+0000","last_became_peered":"2024-05-08T10:23:47.426406+0000","last_unstale":"2024-05-08T10:23:47.434821+0000","last_undegraded":"2024-05-08T10:23:47.434821+0000","last_fullsized":"2024-05-08T10:23:47.434821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431667+0000","last_change":"2024-05-08T10:23:47.431667+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431667+0000","last_undegraded":"2024-05-08T10:23:47.431667+0000","last_fullsized":"2024-05-08T10:23:47.431667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.444562+0000","last_change":"2024-05-08T10:23:47.440567+0000","last_active":"2024-05-08T10:23:47.444562+0000","last_peered":"2024-05-08T10:23:47.444562+0000","last_clean":"2024-05-08T10:23:47.444562+0000","last_became_active":"2024-05-08T10:23:47.440075+0000","last_became_peered":"2024-05-08T10:23:47.440075+0000","last_unstale":"2024-05-08T10:23:47.444562+0000","last_undegraded":"2024-05-08T10:23:47.444562+0000","last_fullsized":"2024-05-08T10:23:47.444562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423790+0000","last_change":"2024-05-08T10:23:47.423790+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423790+0000","last_undegraded":"2024-05-08T10:23:47.423790+0000","last_fullsized":"2024-05-08T10:23:47.423790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440915+0000","last_change":"2024-05-08T10:23:47.439238+0000","last_active":"2024-05-08T10:23:47.440915+0000","last_peered":"2024-05-08T10:23:47.440915+0000","last_clean":"2024-05-08T10:23:47.440915+0000","last_became_active":"2024-05-08T10:23:47.438965+0000","last_became_peered":"2024-05-08T10:23:47.438965+0000","last_unstale":"2024-05-08T10:23:47.440915+0000","last_undegraded":"2024-05-08T10:23:47.440915+0000","last_fullsized":"2024-05-08T10:23:47.440915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426981+0000","last_change":"2024-05-08T10:23:47.426981+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426981+0000","last_undegraded":"2024-05-08T10:23:47.426981+0000","last_fullsized":"2024-05-08T10:23:47.426981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447420+0000","last_change":"2024-05-08T10:23:47.443886+0000","last_active":"2024-05-08T10:23:47.447420+0000","last_peered":"2024-05-08T10:23:47.447420+0000","last_clean":"2024-05-08T10:23:47.447420+0000","last_became_active":"2024-05-08T10:23:47.443654+0000","last_became_peered":"2024-05-08T10:23:47.443654+0000","last_unstale":"2024-05-08T10:23:47.447420+0000","last_undegraded":"2024-05-08T10:23:47.447420+0000","last_fullsized":"2024-05-08T10:23:47.447420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430356+0000","last_change":"2024-05-08T10:23:47.430356+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430356+0000","last_undegraded":"2024-05-08T10:23:47.430356+0000","last_fullsized":"2024-05-08T10:23:47.430356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443418+0000","last_change":"2024-05-08T10:23:47.440367+0000","last_active":"2024-05-08T10:23:47.443418+0000","last_peered":"2024-05-08T10:23:47.443418+0000","last_clean":"2024-05-08T10:23:47.443418+0000","last_became_active":"2024-05-08T10:23:47.440098+0000","last_became_peered":"2024-05-08T10:23:47.440098+0000","last_unstale":"2024-05-08T10:23:47.443418+0000","last_undegraded":"2024-05-08T10:23:47.443418+0000","last_fullsized":"2024-05-08T10:23:47.443418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425319+0000","last_change":"2024-05-08T10:23:47.425319+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425319+0000","last_undegraded":"2024-05-08T10:23:47.425319+0000","last_fullsized":"2024-05-08T10:23:47.425319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447250+0000","last_change":"2024-05-08T10:23:47.441809+0000","last_active":"2024-05-08T10:23:47.447250+0000","last_peered":"2024-05-08T10:23:47.447250+0000","last_clean":"2024-05-08T10:23:47.447250+0000","last_became_active":"2024-05-08T10:23:47.441527+0000","last_became_peered":"2024-05-08T10:23:47.441527+0000","last_unstale":"2024-05-08T10:23:47.447250+0000","last_undegraded":"2024-05-08T10:23:47.447250+0000","last_fullsized":"2024-05-08T10:23:47.447250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428062+0000","last_change":"2024-05-08T10:23:47.428062+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428062+0000","last_undegraded":"2024-05-08T10:23:47.428062+0000","last_fullsized":"2024-05-08T10:23:47.428062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447416+0000","last_change":"2024-05-08T10:23:47.443969+0000","last_active":"2024-05-08T10:23:47.447416+0000","last_peered":"2024-05-08T10:23:47.447416+0000","last_clean":"2024-05-08T10:23:47.447416+0000","last_became_active":"2024-05-08T10:23:47.443699+0000","last_became_peered":"2024-05-08T10:23:47.443699+0000","last_unstale":"2024-05-08T10:23:47.447416+0000","last_undegraded":"2024-05-08T10:23:47.447416+0000","last_fullsized":"2024-05-08T10:23:47.447416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423866+0000","last_change":"2024-05-08T10:23:47.423866+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423866+0000","last_undegraded":"2024-05-08T10:23:47.423866+0000","last_fullsized":"2024-05-08T10:23:47.423866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443627+0000","last_change":"2024-05-08T10:23:47.441563+0000","last_active":"2024-05-08T10:23:47.443627+0000","last_peered":"2024-05-08T10:23:47.443627+0000","last_clean":"2024-05-08T10:23:47.443627+0000","last_became_active":"2024-05-08T10:23:47.441300+0000","last_became_peered":"2024-05-08T10:23:47.441300+0000","last_unstale":"2024-05-08T10:23:47.443627+0000","last_undegraded":"2024-05-08T10:23:47.443627+0000","last_fullsized":"2024-05-08T10:23:47.443627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425290+0000","last_change":"2024-05-08T10:23:47.425290+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425290+0000","last_undegraded":"2024-05-08T10:23:47.425290+0000","last_fullsized":"2024-05-08T10:23:47.425290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440842+0000","last_change":"2024-05-08T10:23:47.438095+0000","last_active":"2024-05-08T10:23:47.440842+0000","last_peered":"2024-05-08T10:23:47.440842+0000","last_clean":"2024-05-08T10:23:47.440842+0000","last_became_active":"2024-05-08T10:23:47.437623+0000","last_became_peered":"2024-05-08T10:23:47.437623+0000","last_unstale":"2024-05-08T10:23:47.440842+0000","last_undegraded":"2024-05-08T10:23:47.440842+0000","last_fullsized":"2024-05-08T10:23:47.440842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425305+0000","last_change":"2024-05-08T10:23:47.425305+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425305+0000","last_undegraded":"2024-05-08T10:23:47.425305+0000","last_fullsized":"2024-05-08T10:23:47.425305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447360+0000","last_change":"2024-05-08T10:23:47.441909+0000","last_active":"2024-05-08T10:23:47.447360+0000","last_peered":"2024-05-08T10:23:47.447360+0000","last_clean":"2024-05-08T10:23:47.447360+0000","last_became_active":"2024-05-08T10:23:47.441503+0000","last_became_peered":"2024-05-08T10:23:47.441503+0000","last_unstale":"2024-05-08T10:23:47.447360+0000","last_undegraded":"2024-05-08T10:23:47.447360+0000","last_fullsized":"2024-05-08T10:23:47.447360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427269+0000","last_change":"2024-05-08T10:23:47.427269+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427269+0000","last_undegraded":"2024-05-08T10:23:47.427269+0000","last_fullsized":"2024-05-08T10:23:47.427269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427572+0000","last_change":"2024-05-08T10:23:47.427572+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427572+0000","last_undegraded":"2024-05-08T10:23:47.427572+0000","last_fullsized":"2024-05-08T10:23:47.427572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.444331+0000","last_change":"2024-05-08T10:23:47.439945+0000","last_active":"2024-05-08T10:23:47.444331+0000","last_peered":"2024-05-08T10:23:47.444331+0000","last_clean":"2024-05-08T10:23:47.444331+0000","last_became_active":"2024-05-08T10:23:47.439631+0000","last_became_peered":"2024-05-08T10:23:47.439631+0000","last_unstale":"2024-05-08T10:23:47.444331+0000","last_undegraded":"2024-05-08T10:23:47.444331+0000","last_fullsized":"2024-05-08T10:23:47.444331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429334+0000","last_change":"2024-05-08T10:23:47.429334+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429334+0000","last_undegraded":"2024-05-08T10:23:47.429334+0000","last_fullsized":"2024-05-08T10:23:47.429334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447396+0000","last_change":"2024-05-08T10:23:47.442600+0000","last_active":"2024-05-08T10:23:47.447396+0000","last_peered":"2024-05-08T10:23:47.447396+0000","last_clean":"2024-05-08T10:23:47.447396+0000","last_became_active":"2024-05-08T10:23:47.441385+0000","last_became_peered":"2024-05-08T10:23:47.441385+0000","last_unstale":"2024-05-08T10:23:47.447396+0000","last_undegraded":"2024-05-08T10:23:47.447396+0000","last_fullsized":"2024-05-08T10:23:47.447396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429673+0000","last_change":"2024-05-08T10:23:47.429673+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429673+0000","last_undegraded":"2024-05-08T10:23:47.429673+0000","last_fullsized":"2024-05-08T10:23:47.429673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.438367+0000","last_change":"2024-05-08T10:23:47.435845+0000","last_active":"2024-05-08T10:23:47.438367+0000","last_peered":"2024-05-08T10:23:47.438367+0000","last_clean":"2024-05-08T10:23:47.438367+0000","last_became_active":"2024-05-08T10:23:47.435557+0000","last_became_peered":"2024-05-08T10:23:47.435557+0000","last_unstale":"2024-05-08T10:23:47.438367+0000","last_undegraded":"2024-05-08T10:23:47.438367+0000","last_fullsized":"2024-05-08T10:23:47.438367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425885+0000","last_change":"2024-05-08T10:23:47.425885+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425885+0000","last_undegraded":"2024-05-08T10:23:47.425885+0000","last_fullsized":"2024-05-08T10:23:47.425885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443369+0000","last_change":"2024-05-08T10:23:47.439956+0000","last_active":"2024-05-08T10:23:47.443369+0000","last_peered":"2024-05-08T10:23:47.443369+0000","last_clean":"2024-05-08T10:23:47.443369+0000","last_became_active":"2024-05-08T10:23:47.439661+0000","last_became_peered":"2024-05-08T10:23:47.439661+0000","last_unstale":"2024-05-08T10:23:47.443369+0000","last_undegraded":"2024-05-08T10:23:47.443369+0000","last_fullsized":"2024-05-08T10:23:47.443369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":774144,"data_stored":648227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:23:51.755 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:23:51.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.904+0000 7f955b8bb640 1 Processor -- start 2024-05-08T10:23:51.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.904+0000 7f955b8bb640 1 -- start start 2024-05-08T10:23:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.905+0000 7f955b8bb640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95541423c0 0x7f9554142a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.905+0000 7f955b8bb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9554142f50 con 0x7f95540d3a00 2024-05-08T10:23:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.905+0000 7f955b8bb640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f955415fca0 con 0x7f9554163800 2024-05-08T10:23:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.905+0000 7f955b8bb640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f95541608b0 con 0x7f95541423c0 2024-05-08T10:23:51.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.905+0000 7f9559e58640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f95540d3a00 0x7f9554144dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54248/0 (socket says 172.21.15.143:54248) 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.905+0000 7f9559e58640 1 -- 172.21.15.143:0/1456436105 learned_addr learned my addr 172.21.15.143:0/1456436105 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.905+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328885562 0 0) 0x7f9554142f50 con 0x7f95540d3a00 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.905+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f953c003520 con 0x7f95540d3a00 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.905+0000 7f9559657640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95541423c0 0x7f9554142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 537783634 0 0) 0x7f953c003520 con 0x7f95540d3a00 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95541423c0 msgr2=0x7f9554142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95541423c0 0x7f9554142a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 >> v1:172.21.15.163:6789/0 conn(0x7f9554163800 legacy=0x7f95540d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955415ff80 con 0x7f95540d3a00 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f954c0016f0 con 0x7f95540d3a00 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 >> v1:172.21.15.143:6789/0 conn(0x7f95540d3a00 legacy=0x7f9554144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f953c003a30 0x7f953c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f953c004800 0x7f953c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95541423c0 0x7f953c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f95541608b0 con 0x7f953c003a30 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f953c00baf0 con 0x7f953c004800 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f953c00bcf0 con 0x7f95541423c0 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9559657640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f953c003a30 0x7f953c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9558e56640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f953c004800 0x7f953c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9559e58640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95541423c0 0x7f953c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9559657640 1 -- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95541423c0 msgr2=0x7f953c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9559657640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95541423c0 0x7f953c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9559657640 1 -- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f953c004800 msgr2=0x7f953c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9559657640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f953c004800 0x7f953c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9559657640 1 -- 172.21.15.143:0/1456436105 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c003520 con 0x7f953c003a30 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.906+0000 7f9559e58640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95541423c0 0x7f953c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.907+0000 7f9559657640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f953c003a30 0x7f953c003e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9544009fc0 tx=0x7f953c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d659e2b275004b75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.907+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544009c10 con 0x7f953c003a30 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.907+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9544036070 con 0x7f953c003a30 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.907+0000 7f9553fff640 1 -- 172.21.15.143:0/1456436105 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544031880 con 0x7f953c003a30 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.907+0000 7f955b8bb640 1 -- 172.21.15.143:0/1456436105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f953c003a30 msgr2=0x7f953c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.907+0000 7f955b8bb640 1 --2- 172.21.15.143:0/1456436105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f953c003a30 0x7f953c003e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9544009fc0 tx=0x7f953c005830 comp rx=0 tx=0).stop 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.907+0000 7f9559e58640 1 -- 172.21.15.143:0/1456436105 reap_dead start 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.907+0000 7f955b8bb640 1 -- 172.21.15.143:0/1456436105 shutdown_connections 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.907+0000 7f955b8bb640 1 -- 172.21.15.143:0/1456436105 >> 172.21.15.143:0/1456436105 conn(0x7f95540682f0 msgr2=0x7f9554068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.908+0000 7f955b8bb640 1 -- 172.21.15.143:0/1456436105 shutdown_connections 2024-05-08T10:23:51.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.908+0000 7f955b8bb640 1 -- 172.21.15.143:0/1456436105 wait complete. 2024-05-08T10:23:51.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.909+0000 7f955b8bb640 1 Processor -- start 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.909+0000 7f955b8bb640 1 -- start start 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.909+0000 7f955b8bb640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f953c003a30 0x7f9554140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.909+0000 7f955b8bb640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95540b5a40 0x7f9554160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.909+0000 7f955b8bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9554141730 0x7f95541613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.909+0000 7f955b8bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f95541630a0 con 0x7f9554141730 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.909+0000 7f955b8bb640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9554160540 con 0x7f953c003a30 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.909+0000 7f955b8bb640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9554163220 con 0x7f95540b5a40 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559e58640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9554141730 0x7f95541613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559e58640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9554141730 0x7f95541613f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58782/0 (socket says 172.21.15.143:58782) 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559e58640 1 -- 172.21.15.143:0/4002466283 learned_addr learned my addr 172.21.15.143:0/4002466283 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:51.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9558e56640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95540b5a40 0x7f9554160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559e58640 1 -- 172.21.15.143:0/4002466283 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95540b5a40 msgr2=0x7f9554160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559e58640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95540b5a40 0x7f9554160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559657640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f953c003a30 0x7f9554140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559e58640 1 -- 172.21.15.143:0/4002466283 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f953c003a30 msgr2=0x7f9554140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559e58640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f953c003a30 0x7f9554140f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559e58640 1 -- 172.21.15.143:0/4002466283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9554156d70 con 0x7f9554141730 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9559e58640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9554141730 0x7f95541613f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f954c000c00 tx=0x7f954c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9551ffb640 1 -- 172.21.15.143:0/4002466283 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c00c5b0 con 0x7f9554141730 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9551ffb640 1 -- 172.21.15.143:0/4002466283 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954c018070 con 0x7f9554141730 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9554157050 con 0x7f9554141730 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f9551ffb640 1 -- 172.21.15.143:0/4002466283 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c00c990 con 0x7f9554141730 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.910+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9554157610 con 0x7f9554141730 2024-05-08T10:23:51.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.911+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9554075dc0 con 0x7f9554141730 2024-05-08T10:23:51.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.912+0000 7f9551ffb640 1 -- 172.21.15.143:0/4002466283 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f954c00cb30 con 0x7f9554141730 2024-05-08T10:23:51.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.912+0000 7f9551ffb640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9540076300 0x7f95400787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:51.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.913+0000 7f9559657640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9540076300 0x7f95400787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:51.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.913+0000 7f9551ffb640 1 -- 172.21.15.143:0/4002466283 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f954c097040 con 0x7f9554141730 2024-05-08T10:23:51.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.913+0000 7f9559657640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9540076300 0x7f95400787c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9544035000 tx=0x7f954402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:51.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:51.917+0000 7f9551ffb640 1 -- 172.21.15.143:0/4002466283 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f954c060a30 con 0x7f9554141730 2024-05-08T10:23:52.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.095+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f955406a550 con 0x7f9540076300 2024-05-08T10:23:52.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.101+0000 7f9551ffb640 1 -- 172.21.15.143:0/4002466283 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246613 (secure 0 0 0) 0x7f955406a550 con 0x7f9540076300 2024-05-08T10:23:52.089 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:52.091 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:23:52.092 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9540076300 msgr2=0x7f95400787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9540076300 0x7f95400787c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9544035000 tx=0x7f954402f000 comp rx=0 tx=0).stop 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9554141730 msgr2=0x7f95541613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9554141730 0x7f95541613f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f954c000c00 tx=0x7f954c00eb90 comp rx=0 tx=0).stop 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 shutdown_connections 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9540076300 0x7f95400787c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9554141730 0x7f95541613f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f95540b5a40 0x7f9554160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 --2- 172.21.15.143:0/4002466283 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f953c003a30 0x7f9554140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 >> 172.21.15.143:0/4002466283 conn(0x7f95540682f0 msgr2=0x7f955415d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 shutdown_connections 2024-05-08T10:23:52.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.104+0000 7f955b8bb640 1 -- 172.21.15.143:0/4002466283 wait complete. 2024-05-08T10:23:52.101 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-05-08T10:23:50.524933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":2508,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":2568192,"data_stored":1612233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.101000"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431662+0000","last_change":"2024-05-08T10:23:47.431662+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431662+0000","last_undegraded":"2024-05-08T10:23:47.431662+0000","last_fullsized":"2024-05-08T10:23:47.431662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431196+0000","last_change":"2024-05-08T10:23:47.431196+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431196+0000","last_undegraded":"2024-05-08T10:23:47.431196+0000","last_fullsized":"2024-05-08T10:23:47.431196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427104+0000","last_change":"2024-05-08T10:23:47.427104+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427104+0000","last_undegraded":"2024-05-08T10:23:47.427104+0000","last_fullsized":"2024-05-08T10:23:47.427104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429800+0000","last_change":"2024-05-08T10:23:47.429800+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429800+0000","last_undegraded":"2024-05-08T10:23:47.429800+0000","last_fullsized":"2024-05-08T10:23:47.429800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.435270+0000","last_change":"2024-05-08T10:23:47.435270+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.435270+0000","last_undegraded":"2024-05-08T10:23:47.435270+0000","last_fullsized":"2024-05-08T10:23:47.435270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433166+0000","last_change":"2024-05-08T10:23:47.433166+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433166+0000","last_undegraded":"2024-05-08T10:23:47.433166+0000","last_fullsized":"2024-05-08T10:23:47.433166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431815+0000","last_change":"2024-05-08T10:23:47.431815+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431815+0000","last_undegraded":"2024-05-08T10:23:47.431815+0000","last_fullsized":"2024-05-08T10:23:47.431815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426758+0000","last_change":"2024-05-08T10:23:47.426758+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426758+0000","last_undegraded":"2024-05-08T10:23:47.426758+0000","last_fullsized":"2024-05-08T10:23:47.426758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431039+0000","last_change":"2024-05-08T10:23:47.431039+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431039+0000","last_undegraded":"2024-05-08T10:23:47.431039+0000","last_fullsized":"2024-05-08T10:23:47.431039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428458+0000","last_change":"2024-05-08T10:23:47.428458+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428458+0000","last_undegraded":"2024-05-08T10:23:47.428458+0000","last_fullsized":"2024-05-08T10:23:47.428458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426526+0000","last_change":"2024-05-08T10:23:47.426526+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426526+0000","last_undegraded":"2024-05-08T10:23:47.426526+0000","last_fullsized":"2024-05-08T10:23:47.426526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425230+0000","last_change":"2024-05-08T10:23:47.425230+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425230+0000","last_undegraded":"2024-05-08T10:23:47.425230+0000","last_fullsized":"2024-05-08T10:23:47.425230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426133+0000","last_change":"2024-05-08T10:23:47.426133+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426133+0000","last_undegraded":"2024-05-08T10:23:47.426133+0000","last_fullsized":"2024-05-08T10:23:47.426133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429210+0000","last_change":"2024-05-08T10:23:47.429210+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429210+0000","last_undegraded":"2024-05-08T10:23:47.429210+0000","last_fullsized":"2024-05-08T10:23:47.429210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431289+0000","last_change":"2024-05-08T10:23:47.431289+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431289+0000","last_undegraded":"2024-05-08T10:23:47.431289+0000","last_fullsized":"2024-05-08T10:23:47.431289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430746+0000","last_change":"2024-05-08T10:23:47.430746+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430746+0000","last_undegraded":"2024-05-08T10:23:47.430746+0000","last_fullsized":"2024-05-08T10:23:47.430746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426764+0000","last_change":"2024-05-08T10:23:47.426764+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426764+0000","last_undegraded":"2024-05-08T10:23:47.426764+0000","last_fullsized":"2024-05-08T10:23:47.426764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.422801+0000","last_change":"2024-05-08T10:23:47.422801+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.422801+0000","last_undegraded":"2024-05-08T10:23:47.422801+0000","last_fullsized":"2024-05-08T10:23:47.422801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430500+0000","last_change":"2024-05-08T10:23:47.430500+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430500+0000","last_undegraded":"2024-05-08T10:23:47.430500+0000","last_fullsized":"2024-05-08T10:23:47.430500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426934+0000","last_change":"2024-05-08T10:23:47.426934+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426934+0000","last_undegraded":"2024-05-08T10:23:47.426934+0000","last_fullsized":"2024-05-08T10:23:47.426934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430150+0000","last_change":"2024-05-08T10:23:47.430150+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430150+0000","last_undegraded":"2024-05-08T10:23:47.430150+0000","last_fullsized":"2024-05-08T10:23:47.430150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432262+0000","last_change":"2024-05-08T10:23:47.432262+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432262+0000","last_undegraded":"2024-05-08T10:23:47.432262+0000","last_fullsized":"2024-05-08T10:23:47.432262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426116+0000","last_change":"2024-05-08T10:23:47.426116+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426116+0000","last_undegraded":"2024-05-08T10:23:47.426116+0000","last_fullsized":"2024-05-08T10:23:47.426116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430285+0000","last_change":"2024-05-08T10:23:47.430285+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430285+0000","last_undegraded":"2024-05-08T10:23:47.430285+0000","last_fullsized":"2024-05-08T10:23:47.430285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426086+0000","last_change":"2024-05-08T10:23:47.426086+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426086+0000","last_undegraded":"2024-05-08T10:23:47.426086+0000","last_fullsized":"2024-05-08T10:23:47.426086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426748+0000","last_change":"2024-05-08T10:23:47.426748+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426748+0000","last_undegraded":"2024-05-08T10:23:47.426748+0000","last_fullsized":"2024-05-08T10:23:47.426748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431014+0000","last_change":"2024-05-08T10:23:47.431014+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431014+0000","last_undegraded":"2024-05-08T10:23:47.431014+0000","last_fullsized":"2024-05-08T10:23:47.431014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426126+0000","last_change":"2024-05-08T10:23:47.426126+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426126+0000","last_undegraded":"2024-05-08T10:23:47.426126+0000","last_fullsized":"2024-05-08T10:23:47.426126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429756+0000","last_change":"2024-05-08T10:23:47.429756+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429756+0000","last_undegraded":"2024-05-08T10:23:47.429756+0000","last_fullsized":"2024-05-08T10:23:47.429756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431739+0000","last_change":"2024-05-08T10:23:47.431739+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431739+0000","last_undegraded":"2024-05-08T10:23:47.431739+0000","last_fullsized":"2024-05-08T10:23:47.431739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423041+0000","last_change":"2024-05-08T10:23:47.423041+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423041+0000","last_undegraded":"2024-05-08T10:23:47.423041+0000","last_fullsized":"2024-05-08T10:23:47.423041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428027+0000","last_change":"2024-05-08T10:23:47.428027+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428027+0000","last_undegraded":"2024-05-08T10:23:47.428027+0000","last_fullsized":"2024-05-08T10:23:47.428027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423709+0000","last_change":"2024-05-08T10:23:47.423709+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423709+0000","last_undegraded":"2024-05-08T10:23:47.423709+0000","last_fullsized":"2024-05-08T10:23:47.423709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443494+0000","last_change":"2024-05-08T10:23:47.440565+0000","last_active":"2024-05-08T10:23:47.443494+0000","last_peered":"2024-05-08T10:23:47.443494+0000","last_clean":"2024-05-08T10:23:47.443494+0000","last_became_active":"2024-05-08T10:23:47.440296+0000","last_became_peered":"2024-05-08T10:23:47.440296+0000","last_unstale":"2024-05-08T10:23:47.443494+0000","last_undegraded":"2024-05-08T10:23:47.443494+0000","last_fullsized":"2024-05-08T10:23:47.443494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429282+0000","last_change":"2024-05-08T10:23:47.429282+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429282+0000","last_undegraded":"2024-05-08T10:23:47.429282+0000","last_fullsized":"2024-05-08T10:23:47.429282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.435127+0000","last_change":"2024-05-08T10:23:47.432111+0000","last_active":"2024-05-08T10:23:47.435127+0000","last_peered":"2024-05-08T10:23:47.435127+0000","last_clean":"2024-05-08T10:23:47.435127+0000","last_became_active":"2024-05-08T10:23:47.430756+0000","last_became_peered":"2024-05-08T10:23:47.430756+0000","last_unstale":"2024-05-08T10:23:47.435127+0000","last_undegraded":"2024-05-08T10:23:47.435127+0000","last_fullsized":"2024-05-08T10:23:47.435127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.437909+0000","last_change":"2024-05-08T10:23:47.431893+0000","last_active":"2024-05-08T10:23:47.437909+0000","last_peered":"2024-05-08T10:23:47.437909+0000","last_clean":"2024-05-08T10:23:47.437909+0000","last_became_active":"2024-05-08T10:23:47.431613+0000","last_became_peered":"2024-05-08T10:23:47.431613+0000","last_unstale":"2024-05-08T10:23:47.437909+0000","last_undegraded":"2024-05-08T10:23:47.437909+0000","last_fullsized":"2024-05-08T10:23:47.437909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425824+0000","last_change":"2024-05-08T10:23:47.425824+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425824+0000","last_undegraded":"2024-05-08T10:23:47.425824+0000","last_fullsized":"2024-05-08T10:23:47.425824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.438599+0000","last_change":"2024-05-08T10:23:47.436762+0000","last_active":"2024-05-08T10:23:47.438599+0000","last_peered":"2024-05-08T10:23:47.438599+0000","last_clean":"2024-05-08T10:23:47.438599+0000","last_became_active":"2024-05-08T10:23:47.436442+0000","last_became_peered":"2024-05-08T10:23:47.436442+0000","last_unstale":"2024-05-08T10:23:47.438599+0000","last_undegraded":"2024-05-08T10:23:47.438599+0000","last_fullsized":"2024-05-08T10:23:47.438599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432795+0000","last_change":"2024-05-08T10:23:47.432795+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432795+0000","last_undegraded":"2024-05-08T10:23:47.432795+0000","last_fullsized":"2024-05-08T10:23:47.432795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440383+0000","last_change":"2024-05-08T10:23:47.439183+0000","last_active":"2024-05-08T10:23:47.440383+0000","last_peered":"2024-05-08T10:23:47.440383+0000","last_clean":"2024-05-08T10:23:47.440383+0000","last_became_active":"2024-05-08T10:23:47.438842+0000","last_became_peered":"2024-05-08T10:23:47.438842+0000","last_unstale":"2024-05-08T10:23:47.440383+0000","last_undegraded":"2024-05-08T10:23:47.440383+0000","last_fullsized":"2024-05-08T10:23:47.440383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432457+0000","last_change":"2024-05-08T10:23:47.432457+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432457+0000","last_undegraded":"2024-05-08T10:23:47.432457+0000","last_fullsized":"2024-05-08T10:23:47.432457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447345+0000","last_change":"2024-05-08T10:23:47.442360+0000","last_active":"2024-05-08T10:23:47.447345+0000","last_peered":"2024-05-08T10:23:47.447345+0000","last_clean":"2024-05-08T10:23:47.447345+0000","last_became_active":"2024-05-08T10:23:47.442107+0000","last_became_peered":"2024-05-08T10:23:47.442107+0000","last_unstale":"2024-05-08T10:23:47.447345+0000","last_undegraded":"2024-05-08T10:23:47.447345+0000","last_fullsized":"2024-05-08T10:23:47.447345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429162+0000","last_change":"2024-05-08T10:23:47.429162+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429162+0000","last_undegraded":"2024-05-08T10:23:47.429162+0000","last_fullsized":"2024-05-08T10:23:47.429162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440894+0000","last_change":"2024-05-08T10:23:47.438561+0000","last_active":"2024-05-08T10:23:47.440894+0000","last_peered":"2024-05-08T10:23:47.440894+0000","last_clean":"2024-05-08T10:23:47.440894+0000","last_became_active":"2024-05-08T10:23:47.437710+0000","last_became_peered":"2024-05-08T10:23:47.437710+0000","last_unstale":"2024-05-08T10:23:47.440894+0000","last_undegraded":"2024-05-08T10:23:47.440894+0000","last_fullsized":"2024-05-08T10:23:47.440894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.424002+0000","last_change":"2024-05-08T10:23:47.424002+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.424002+0000","last_undegraded":"2024-05-08T10:23:47.424002+0000","last_fullsized":"2024-05-08T10:23:47.424002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440316+0000","last_change":"2024-05-08T10:23:47.436584+0000","last_active":"2024-05-08T10:23:47.440316+0000","last_peered":"2024-05-08T10:23:47.440316+0000","last_clean":"2024-05-08T10:23:47.440316+0000","last_became_active":"2024-05-08T10:23:47.436126+0000","last_became_peered":"2024-05-08T10:23:47.436126+0000","last_unstale":"2024-05-08T10:23:47.440316+0000","last_undegraded":"2024-05-08T10:23:47.440316+0000","last_fullsized":"2024-05-08T10:23:47.440316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433327+0000","last_change":"2024-05-08T10:23:47.433327+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433327+0000","last_undegraded":"2024-05-08T10:23:47.433327+0000","last_fullsized":"2024-05-08T10:23:47.433327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440924+0000","last_change":"2024-05-08T10:23:47.435055+0000","last_active":"2024-05-08T10:23:47.440924+0000","last_peered":"2024-05-08T10:23:47.440924+0000","last_clean":"2024-05-08T10:23:47.440924+0000","last_became_active":"2024-05-08T10:23:47.434642+0000","last_became_peered":"2024-05-08T10:23:47.434642+0000","last_unstale":"2024-05-08T10:23:47.440924+0000","last_undegraded":"2024-05-08T10:23:47.440924+0000","last_fullsized":"2024-05-08T10:23:47.440924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:52.768923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427182+0000","last_change":"2024-05-08T10:23:47.427182+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427182+0000","last_undegraded":"2024-05-08T10:23:47.427182+0000","last_fullsized":"2024-05-08T10:23:47.427182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440954+0000","last_change":"2024-05-08T10:23:47.437417+0000","last_active":"2024-05-08T10:23:47.440954+0000","last_peered":"2024-05-08T10:23:47.440954+0000","last_clean":"2024-05-08T10:23:47.440954+0000","last_became_active":"2024-05-08T10:23:47.437129+0000","last_became_peered":"2024-05-08T10:23:47.437129+0000","last_unstale":"2024-05-08T10:23:47.440954+0000","last_undegraded":"2024-05-08T10:23:47.440954+0000","last_fullsized":"2024-05-08T10:23:47.440954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.434415+0000","last_change":"2024-05-08T10:23:47.434415+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.434415+0000","last_undegraded":"2024-05-08T10:23:47.434415+0000","last_fullsized":"2024-05-08T10:23:47.434415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.439691+0000","last_change":"2024-05-08T10:23:47.432460+0000","last_active":"2024-05-08T10:23:47.439691+0000","last_peered":"2024-05-08T10:23:47.439691+0000","last_clean":"2024-05-08T10:23:47.439691+0000","last_became_active":"2024-05-08T10:23:47.432156+0000","last_became_peered":"2024-05-08T10:23:47.432156+0000","last_unstale":"2024-05-08T10:23:47.439691+0000","last_undegraded":"2024-05-08T10:23:47.439691+0000","last_fullsized":"2024-05-08T10:23:47.439691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426210+0000","last_change":"2024-05-08T10:23:47.426210+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426210+0000","last_undegraded":"2024-05-08T10:23:47.426210+0000","last_fullsized":"2024-05-08T10:23:47.426210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443217+0000","last_change":"2024-05-08T10:23:47.439271+0000","last_active":"2024-05-08T10:23:47.443217+0000","last_peered":"2024-05-08T10:23:47.443217+0000","last_clean":"2024-05-08T10:23:47.443217+0000","last_became_active":"2024-05-08T10:23:47.438952+0000","last_became_peered":"2024-05-08T10:23:47.438952+0000","last_unstale":"2024-05-08T10:23:47.443217+0000","last_undegraded":"2024-05-08T10:23:47.443217+0000","last_fullsized":"2024-05-08T10:23:47.443217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431177+0000","last_change":"2024-05-08T10:23:47.431177+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431177+0000","last_undegraded":"2024-05-08T10:23:47.431177+0000","last_fullsized":"2024-05-08T10:23:47.431177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.439100+0000","last_change":"2024-05-08T10:23:47.436054+0000","last_active":"2024-05-08T10:23:47.439100+0000","last_peered":"2024-05-08T10:23:47.439100+0000","last_clean":"2024-05-08T10:23:47.439100+0000","last_became_active":"2024-05-08T10:23:47.435777+0000","last_became_peered":"2024-05-08T10:23:47.435777+0000","last_unstale":"2024-05-08T10:23:47.439100+0000","last_undegraded":"2024-05-08T10:23:47.439100+0000","last_fullsized":"2024-05-08T10:23:47.439100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433200+0000","last_change":"2024-05-08T10:23:47.433200+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433200+0000","last_undegraded":"2024-05-08T10:23:47.433200+0000","last_fullsized":"2024-05-08T10:23:47.433200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.434894+0000","last_change":"2024-05-08T10:23:47.428146+0000","last_active":"2024-05-08T10:23:47.434894+0000","last_peered":"2024-05-08T10:23:47.434894+0000","last_clean":"2024-05-08T10:23:47.434894+0000","last_became_active":"2024-05-08T10:23:47.427826+0000","last_became_peered":"2024-05-08T10:23:47.427826+0000","last_unstale":"2024-05-08T10:23:47.434894+0000","last_undegraded":"2024-05-08T10:23:47.434894+0000","last_fullsized":"2024-05-08T10:23:47.434894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430538+0000","last_change":"2024-05-08T10:23:47.430538+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430538+0000","last_undegraded":"2024-05-08T10:23:47.430538+0000","last_fullsized":"2024-05-08T10:23:47.430538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440876+0000","last_change":"2024-05-08T10:23:47.438474+0000","last_active":"2024-05-08T10:23:47.440876+0000","last_peered":"2024-05-08T10:23:47.440876+0000","last_clean":"2024-05-08T10:23:47.440876+0000","last_became_active":"2024-05-08T10:23:47.437999+0000","last_became_peered":"2024-05-08T10:23:47.437999+0000","last_unstale":"2024-05-08T10:23:47.440876+0000","last_undegraded":"2024-05-08T10:23:47.440876+0000","last_fullsized":"2024-05-08T10:23:47.440876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428870+0000","last_change":"2024-05-08T10:23:47.428870+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428870+0000","last_undegraded":"2024-05-08T10:23:47.428870+0000","last_fullsized":"2024-05-08T10:23:47.428870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440677+0000","last_change":"2024-05-08T10:23:47.437314+0000","last_active":"2024-05-08T10:23:47.440677+0000","last_peered":"2024-05-08T10:23:47.440677+0000","last_clean":"2024-05-08T10:23:47.440677+0000","last_became_active":"2024-05-08T10:23:47.436966+0000","last_became_peered":"2024-05-08T10:23:47.436966+0000","last_unstale":"2024-05-08T10:23:47.440677+0000","last_undegraded":"2024-05-08T10:23:47.440677+0000","last_fullsized":"2024-05-08T10:23:47.440677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432723+0000","last_change":"2024-05-08T10:23:47.432723+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432723+0000","last_undegraded":"2024-05-08T10:23:47.432723+0000","last_fullsized":"2024-05-08T10:23:47.432723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.433995+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:23:47.433995+0000","last_peered":"2024-05-08T10:23:47.433995+0000","last_clean":"2024-05-08T10:23:47.433995+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:23:47.433995+0000","last_undegraded":"2024-05-08T10:23:47.433995+0000","last_fullsized":"2024-05-08T10:23:47.433995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.441755+0000","last_change":"2024-05-08T10:23:47.437924+0000","last_active":"2024-05-08T10:23:47.441755+0000","last_peered":"2024-05-08T10:23:47.441755+0000","last_clean":"2024-05-08T10:23:47.441755+0000","last_became_active":"2024-05-08T10:23:47.437630+0000","last_became_peered":"2024-05-08T10:23:47.437630+0000","last_unstale":"2024-05-08T10:23:47.441755+0000","last_undegraded":"2024-05-08T10:23:47.441755+0000","last_fullsized":"2024-05-08T10:23:47.441755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425302+0000","last_change":"2024-05-08T10:23:47.425302+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425302+0000","last_undegraded":"2024-05-08T10:23:47.425302+0000","last_fullsized":"2024-05-08T10:23:47.425302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447365+0000","last_change":"2024-05-08T10:23:47.442183+0000","last_active":"2024-05-08T10:23:47.447365+0000","last_peered":"2024-05-08T10:23:47.447365+0000","last_clean":"2024-05-08T10:23:47.447365+0000","last_became_active":"2024-05-08T10:23:47.441485+0000","last_became_peered":"2024-05-08T10:23:47.441485+0000","last_unstale":"2024-05-08T10:23:47.447365+0000","last_undegraded":"2024-05-08T10:23:47.447365+0000","last_fullsized":"2024-05-08T10:23:47.447365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427767+0000","last_change":"2024-05-08T10:23:47.427767+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427767+0000","last_undegraded":"2024-05-08T10:23:47.427767+0000","last_fullsized":"2024-05-08T10:23:47.427767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.434821+0000","last_change":"2024-05-08T10:23:47.426677+0000","last_active":"2024-05-08T10:23:47.434821+0000","last_peered":"2024-05-08T10:23:47.434821+0000","last_clean":"2024-05-08T10:23:47.434821+0000","last_became_active":"2024-05-08T10:23:47.426406+0000","last_became_peered":"2024-05-08T10:23:47.426406+0000","last_unstale":"2024-05-08T10:23:47.434821+0000","last_undegraded":"2024-05-08T10:23:47.434821+0000","last_fullsized":"2024-05-08T10:23:47.434821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431667+0000","last_change":"2024-05-08T10:23:47.431667+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431667+0000","last_undegraded":"2024-05-08T10:23:47.431667+0000","last_fullsized":"2024-05-08T10:23:47.431667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.444562+0000","last_change":"2024-05-08T10:23:47.440567+0000","last_active":"2024-05-08T10:23:47.444562+0000","last_peered":"2024-05-08T10:23:47.444562+0000","last_clean":"2024-05-08T10:23:47.444562+0000","last_became_active":"2024-05-08T10:23:47.440075+0000","last_became_peered":"2024-05-08T10:23:47.440075+0000","last_unstale":"2024-05-08T10:23:47.444562+0000","last_undegraded":"2024-05-08T10:23:47.444562+0000","last_fullsized":"2024-05-08T10:23:47.444562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423790+0000","last_change":"2024-05-08T10:23:47.423790+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423790+0000","last_undegraded":"2024-05-08T10:23:47.423790+0000","last_fullsized":"2024-05-08T10:23:47.423790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440915+0000","last_change":"2024-05-08T10:23:47.439238+0000","last_active":"2024-05-08T10:23:47.440915+0000","last_peered":"2024-05-08T10:23:47.440915+0000","last_clean":"2024-05-08T10:23:47.440915+0000","last_became_active":"2024-05-08T10:23:47.438965+0000","last_became_peered":"2024-05-08T10:23:47.438965+0000","last_unstale":"2024-05-08T10:23:47.440915+0000","last_undegraded":"2024-05-08T10:23:47.440915+0000","last_fullsized":"2024-05-08T10:23:47.440915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426981+0000","last_change":"2024-05-08T10:23:47.426981+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426981+0000","last_undegraded":"2024-05-08T10:23:47.426981+0000","last_fullsized":"2024-05-08T10:23:47.426981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447420+0000","last_change":"2024-05-08T10:23:47.443886+0000","last_active":"2024-05-08T10:23:47.447420+0000","last_peered":"2024-05-08T10:23:47.447420+0000","last_clean":"2024-05-08T10:23:47.447420+0000","last_became_active":"2024-05-08T10:23:47.443654+0000","last_became_peered":"2024-05-08T10:23:47.443654+0000","last_unstale":"2024-05-08T10:23:47.447420+0000","last_undegraded":"2024-05-08T10:23:47.447420+0000","last_fullsized":"2024-05-08T10:23:47.447420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430356+0000","last_change":"2024-05-08T10:23:47.430356+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430356+0000","last_undegraded":"2024-05-08T10:23:47.430356+0000","last_fullsized":"2024-05-08T10:23:47.430356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443418+0000","last_change":"2024-05-08T10:23:47.440367+0000","last_active":"2024-05-08T10:23:47.443418+0000","last_peered":"2024-05-08T10:23:47.443418+0000","last_clean":"2024-05-08T10:23:47.443418+0000","last_became_active":"2024-05-08T10:23:47.440098+0000","last_became_peered":"2024-05-08T10:23:47.440098+0000","last_unstale":"2024-05-08T10:23:47.443418+0000","last_undegraded":"2024-05-08T10:23:47.443418+0000","last_fullsized":"2024-05-08T10:23:47.443418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425319+0000","last_change":"2024-05-08T10:23:47.425319+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425319+0000","last_undegraded":"2024-05-08T10:23:47.425319+0000","last_fullsized":"2024-05-08T10:23:47.425319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447250+0000","last_change":"2024-05-08T10:23:47.441809+0000","last_active":"2024-05-08T10:23:47.447250+0000","last_peered":"2024-05-08T10:23:47.447250+0000","last_clean":"2024-05-08T10:23:47.447250+0000","last_became_active":"2024-05-08T10:23:47.441527+0000","last_became_peered":"2024-05-08T10:23:47.441527+0000","last_unstale":"2024-05-08T10:23:47.447250+0000","last_undegraded":"2024-05-08T10:23:47.447250+0000","last_fullsized":"2024-05-08T10:23:47.447250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428062+0000","last_change":"2024-05-08T10:23:47.428062+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428062+0000","last_undegraded":"2024-05-08T10:23:47.428062+0000","last_fullsized":"2024-05-08T10:23:47.428062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447416+0000","last_change":"2024-05-08T10:23:47.443969+0000","last_active":"2024-05-08T10:23:47.447416+0000","last_peered":"2024-05-08T10:23:47.447416+0000","last_clean":"2024-05-08T10:23:47.447416+0000","last_became_active":"2024-05-08T10:23:47.443699+0000","last_became_peered":"2024-05-08T10:23:47.443699+0000","last_unstale":"2024-05-08T10:23:47.447416+0000","last_undegraded":"2024-05-08T10:23:47.447416+0000","last_fullsized":"2024-05-08T10:23:47.447416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423866+0000","last_change":"2024-05-08T10:23:47.423866+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423866+0000","last_undegraded":"2024-05-08T10:23:47.423866+0000","last_fullsized":"2024-05-08T10:23:47.423866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443627+0000","last_change":"2024-05-08T10:23:47.441563+0000","last_active":"2024-05-08T10:23:47.443627+0000","last_peered":"2024-05-08T10:23:47.443627+0000","last_clean":"2024-05-08T10:23:47.443627+0000","last_became_active":"2024-05-08T10:23:47.441300+0000","last_became_peered":"2024-05-08T10:23:47.441300+0000","last_unstale":"2024-05-08T10:23:47.443627+0000","last_undegraded":"2024-05-08T10:23:47.443627+0000","last_fullsized":"2024-05-08T10:23:47.443627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425290+0000","last_change":"2024-05-08T10:23:47.425290+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425290+0000","last_undegraded":"2024-05-08T10:23:47.425290+0000","last_fullsized":"2024-05-08T10:23:47.425290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440842+0000","last_change":"2024-05-08T10:23:47.438095+0000","last_active":"2024-05-08T10:23:47.440842+0000","last_peered":"2024-05-08T10:23:47.440842+0000","last_clean":"2024-05-08T10:23:47.440842+0000","last_became_active":"2024-05-08T10:23:47.437623+0000","last_became_peered":"2024-05-08T10:23:47.437623+0000","last_unstale":"2024-05-08T10:23:47.440842+0000","last_undegraded":"2024-05-08T10:23:47.440842+0000","last_fullsized":"2024-05-08T10:23:47.440842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425305+0000","last_change":"2024-05-08T10:23:47.425305+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425305+0000","last_undegraded":"2024-05-08T10:23:47.425305+0000","last_fullsized":"2024-05-08T10:23:47.425305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447360+0000","last_change":"2024-05-08T10:23:47.441909+0000","last_active":"2024-05-08T10:23:47.447360+0000","last_peered":"2024-05-08T10:23:47.447360+0000","last_clean":"2024-05-08T10:23:47.447360+0000","last_became_active":"2024-05-08T10:23:47.441503+0000","last_became_peered":"2024-05-08T10:23:47.441503+0000","last_unstale":"2024-05-08T10:23:47.447360+0000","last_undegraded":"2024-05-08T10:23:47.447360+0000","last_fullsized":"2024-05-08T10:23:47.447360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427269+0000","last_change":"2024-05-08T10:23:47.427269+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427269+0000","last_undegraded":"2024-05-08T10:23:47.427269+0000","last_fullsized":"2024-05-08T10:23:47.427269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427572+0000","last_change":"2024-05-08T10:23:47.427572+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427572+0000","last_undegraded":"2024-05-08T10:23:47.427572+0000","last_fullsized":"2024-05-08T10:23:47.427572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.444331+0000","last_change":"2024-05-08T10:23:47.439945+0000","last_active":"2024-05-08T10:23:47.444331+0000","last_peered":"2024-05-08T10:23:47.444331+0000","last_clean":"2024-05-08T10:23:47.444331+0000","last_became_active":"2024-05-08T10:23:47.439631+0000","last_became_peered":"2024-05-08T10:23:47.439631+0000","last_unstale":"2024-05-08T10:23:47.444331+0000","last_undegraded":"2024-05-08T10:23:47.444331+0000","last_fullsized":"2024-05-08T10:23:47.444331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429334+0000","last_change":"2024-05-08T10:23:47.429334+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429334+0000","last_undegraded":"2024-05-08T10:23:47.429334+0000","last_fullsized":"2024-05-08T10:23:47.429334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447396+0000","last_change":"2024-05-08T10:23:47.442600+0000","last_active":"2024-05-08T10:23:47.447396+0000","last_peered":"2024-05-08T10:23:47.447396+0000","last_clean":"2024-05-08T10:23:47.447396+0000","last_became_active":"2024-05-08T10:23:47.441385+0000","last_became_peered":"2024-05-08T10:23:47.441385+0000","last_unstale":"2024-05-08T10:23:47.447396+0000","last_undegraded":"2024-05-08T10:23:47.447396+0000","last_fullsized":"2024-05-08T10:23:47.447396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429673+0000","last_change":"2024-05-08T10:23:47.429673+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429673+0000","last_undegraded":"2024-05-08T10:23:47.429673+0000","last_fullsized":"2024-05-08T10:23:47.429673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.438367+0000","last_change":"2024-05-08T10:23:47.435845+0000","last_active":"2024-05-08T10:23:47.438367+0000","last_peered":"2024-05-08T10:23:47.438367+0000","last_clean":"2024-05-08T10:23:47.438367+0000","last_became_active":"2024-05-08T10:23:47.435557+0000","last_became_peered":"2024-05-08T10:23:47.435557+0000","last_unstale":"2024-05-08T10:23:47.438367+0000","last_undegraded":"2024-05-08T10:23:47.438367+0000","last_fullsized":"2024-05-08T10:23:47.438367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425885+0000","last_change":"2024-05-08T10:23:47.425885+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425885+0000","last_undegraded":"2024-05-08T10:23:47.425885+0000","last_fullsized":"2024-05-08T10:23:47.425885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443369+0000","last_change":"2024-05-08T10:23:47.439956+0000","last_active":"2024-05-08T10:23:47.443369+0000","last_peered":"2024-05-08T10:23:47.443369+0000","last_clean":"2024-05-08T10:23:47.443369+0000","last_became_active":"2024-05-08T10:23:47.439661+0000","last_became_peered":"2024-05-08T10:23:47.439661+0000","last_unstale":"2024-05-08T10:23:47.443369+0000","last_undegraded":"2024-05-08T10:23:47.443369+0000","last_fullsized":"2024-05-08T10:23:47.443369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":774144,"data_stored":648227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:23:52.105 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-05-08T10:23:52.105 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.431662+0000', 'last_change': '2024-05-08T10:23:47.431662+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.431662+0000', 'last_undegraded': '2024-05-08T10:23:47.431662+0000', 'last_fullsized': '2024-05-08T10:23:47.431662+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.106 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-05-08T10:23:52.106 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.431196+0000', 'last_change': '2024-05-08T10:23:47.431196+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.431196+0000', 'last_undegraded': '2024-05-08T10:23:47.431196+0000', 'last_fullsized': '2024-05-08T10:23:47.431196+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:23:52.106 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-05-08T10:23:52.106 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.427104+0000', 'last_change': '2024-05-08T10:23:47.427104+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.427104+0000', 'last_undegraded': '2024-05-08T10:23:47.427104+0000', 'last_fullsized': '2024-05-08T10:23:47.427104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.106 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-05-08T10:23:52.106 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.429800+0000', 'last_change': '2024-05-08T10:23:47.429800+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.429800+0000', 'last_undegraded': '2024-05-08T10:23:47.429800+0000', 'last_fullsized': '2024-05-08T10:23:47.429800+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.435270+0000', 'last_change': '2024-05-08T10:23:47.435270+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.435270+0000', 'last_undegraded': '2024-05-08T10:23:47.435270+0000', 'last_fullsized': '2024-05-08T10:23:47.435270+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.433166+0000', 'last_change': '2024-05-08T10:23:47.433166+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.433166+0000', 'last_undegraded': '2024-05-08T10:23:47.433166+0000', 'last_fullsized': '2024-05-08T10:23:47.433166+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.431815+0000', 'last_change': '2024-05-08T10:23:47.431815+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.431815+0000', 'last_undegraded': '2024-05-08T10:23:47.431815+0000', 'last_fullsized': '2024-05-08T10:23:47.431815+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426758+0000', 'last_change': '2024-05-08T10:23:47.426758+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426758+0000', 'last_undegraded': '2024-05-08T10:23:47.426758+0000', 'last_fullsized': '2024-05-08T10:23:47.426758+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.431039+0000', 'last_change': '2024-05-08T10:23:47.431039+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.431039+0000', 'last_undegraded': '2024-05-08T10:23:47.431039+0000', 'last_fullsized': '2024-05-08T10:23:47.431039+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.107 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.428458+0000', 'last_change': '2024-05-08T10:23:47.428458+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.428458+0000', 'last_undegraded': '2024-05-08T10:23:47.428458+0000', 'last_fullsized': '2024-05-08T10:23:47.428458+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426526+0000', 'last_change': '2024-05-08T10:23:47.426526+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426526+0000', 'last_undegraded': '2024-05-08T10:23:47.426526+0000', 'last_fullsized': '2024-05-08T10:23:47.426526+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.425230+0000', 'last_change': '2024-05-08T10:23:47.425230+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.425230+0000', 'last_undegraded': '2024-05-08T10:23:47.425230+0000', 'last_fullsized': '2024-05-08T10:23:47.425230+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426133+0000', 'last_change': '2024-05-08T10:23:47.426133+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426133+0000', 'last_undegraded': '2024-05-08T10:23:47.426133+0000', 'last_fullsized': '2024-05-08T10:23:47.426133+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.429210+0000', 'last_change': '2024-05-08T10:23:47.429210+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.429210+0000', 'last_undegraded': '2024-05-08T10:23:47.429210+0000', 'last_fullsized': '2024-05-08T10:23:47.429210+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.431289+0000', 'last_change': '2024-05-08T10:23:47.431289+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.431289+0000', 'last_undegraded': '2024-05-08T10:23:47.431289+0000', 'last_fullsized': '2024-05-08T10:23:47.431289+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:23:52.108 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.430746+0000', 'last_change': '2024-05-08T10:23:47.430746+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.430746+0000', 'last_undegraded': '2024-05-08T10:23:47.430746+0000', 'last_fullsized': '2024-05-08T10:23:47.430746+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426764+0000', 'last_change': '2024-05-08T10:23:47.426764+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426764+0000', 'last_undegraded': '2024-05-08T10:23:47.426764+0000', 'last_fullsized': '2024-05-08T10:23:47.426764+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.422801+0000', 'last_change': '2024-05-08T10:23:47.422801+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.422801+0000', 'last_undegraded': '2024-05-08T10:23:47.422801+0000', 'last_fullsized': '2024-05-08T10:23:47.422801+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.430500+0000', 'last_change': '2024-05-08T10:23:47.430500+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.430500+0000', 'last_undegraded': '2024-05-08T10:23:47.430500+0000', 'last_fullsized': '2024-05-08T10:23:47.430500+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426934+0000', 'last_change': '2024-05-08T10:23:47.426934+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426934+0000', 'last_undegraded': '2024-05-08T10:23:47.426934+0000', 'last_fullsized': '2024-05-08T10:23:47.426934+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-05-08T10:23:52.109 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.430150+0000', 'last_change': '2024-05-08T10:23:47.430150+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.430150+0000', 'last_undegraded': '2024-05-08T10:23:47.430150+0000', 'last_fullsized': '2024-05-08T10:23:47.430150+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.110 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-05-08T10:23:52.110 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.432262+0000', 'last_change': '2024-05-08T10:23:47.432262+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.432262+0000', 'last_undegraded': '2024-05-08T10:23:47.432262+0000', 'last_fullsized': '2024-05-08T10:23:47.432262+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.110 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-05-08T10:23:52.110 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426116+0000', 'last_change': '2024-05-08T10:23:47.426116+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426116+0000', 'last_undegraded': '2024-05-08T10:23:47.426116+0000', 'last_fullsized': '2024-05-08T10:23:47.426116+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.110 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-05-08T10:23:52.110 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.430285+0000', 'last_change': '2024-05-08T10:23:47.430285+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.430285+0000', 'last_undegraded': '2024-05-08T10:23:47.430285+0000', 'last_fullsized': '2024-05-08T10:23:47.430285+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.110 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-05-08T10:23:52.110 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426086+0000', 'last_change': '2024-05-08T10:23:47.426086+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426086+0000', 'last_undegraded': '2024-05-08T10:23:47.426086+0000', 'last_fullsized': '2024-05-08T10:23:47.426086+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.110 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426748+0000', 'last_change': '2024-05-08T10:23:47.426748+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426748+0000', 'last_undegraded': '2024-05-08T10:23:47.426748+0000', 'last_fullsized': '2024-05-08T10:23:47.426748+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.431014+0000', 'last_change': '2024-05-08T10:23:47.431014+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.431014+0000', 'last_undegraded': '2024-05-08T10:23:47.431014+0000', 'last_fullsized': '2024-05-08T10:23:47.431014+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426126+0000', 'last_change': '2024-05-08T10:23:47.426126+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426126+0000', 'last_undegraded': '2024-05-08T10:23:47.426126+0000', 'last_fullsized': '2024-05-08T10:23:47.426126+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.429756+0000', 'last_change': '2024-05-08T10:23:47.429756+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.429756+0000', 'last_undegraded': '2024-05-08T10:23:47.429756+0000', 'last_fullsized': '2024-05-08T10:23:47.429756+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.431739+0000', 'last_change': '2024-05-08T10:23:47.431739+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.431739+0000', 'last_undegraded': '2024-05-08T10:23:47.431739+0000', 'last_fullsized': '2024-05-08T10:23:47.431739+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-05-08T10:23:52.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.423041+0000', 'last_change': '2024-05-08T10:23:47.423041+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.423041+0000', 'last_undegraded': '2024-05-08T10:23:47.423041+0000', 'last_fullsized': '2024-05-08T10:23:47.423041+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.428027+0000', 'last_change': '2024-05-08T10:23:47.428027+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.428027+0000', 'last_undegraded': '2024-05-08T10:23:47.428027+0000', 'last_fullsized': '2024-05-08T10:23:47.428027+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.423709+0000', 'last_change': '2024-05-08T10:23:47.423709+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.423709+0000', 'last_undegraded': '2024-05-08T10:23:47.423709+0000', 'last_fullsized': '2024-05-08T10:23:47.423709+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.429282+0000', 'last_change': '2024-05-08T10:23:47.429282+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.429282+0000', 'last_undegraded': '2024-05-08T10:23:47.429282+0000', 'last_fullsized': '2024-05-08T10:23:47.429282+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.425824+0000', 'last_change': '2024-05-08T10:23:47.425824+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.425824+0000', 'last_undegraded': '2024-05-08T10:23:47.425824+0000', 'last_fullsized': '2024-05-08T10:23:47.425824+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.432795+0000', 'last_change': '2024-05-08T10:23:47.432795+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.432795+0000', 'last_undegraded': '2024-05-08T10:23:47.432795+0000', 'last_fullsized': '2024-05-08T10:23:47.432795+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:23:52.112 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-05-08T10:23:52.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.432457+0000', 'last_change': '2024-05-08T10:23:47.432457+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.432457+0000', 'last_undegraded': '2024-05-08T10:23:47.432457+0000', 'last_fullsized': '2024-05-08T10:23:47.432457+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.113 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-05-08T10:23:52.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.429162+0000', 'last_change': '2024-05-08T10:23:47.429162+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.429162+0000', 'last_undegraded': '2024-05-08T10:23:47.429162+0000', 'last_fullsized': '2024-05-08T10:23:47.429162+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.113 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-05-08T10:23:52.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.424002+0000', 'last_change': '2024-05-08T10:23:47.424002+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.424002+0000', 'last_undegraded': '2024-05-08T10:23:47.424002+0000', 'last_fullsized': '2024-05-08T10:23:47.424002+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:23:52.113 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-05-08T10:23:52.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.433327+0000', 'last_change': '2024-05-08T10:23:47.433327+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.433327+0000', 'last_undegraded': '2024-05-08T10:23:47.433327+0000', 'last_fullsized': '2024-05-08T10:23:47.433327+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.113 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-05-08T10:23:52.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.427182+0000', 'last_change': '2024-05-08T10:23:47.427182+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.427182+0000', 'last_undegraded': '2024-05-08T10:23:47.427182+0000', 'last_fullsized': '2024-05-08T10:23:47.427182+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.434415+0000', 'last_change': '2024-05-08T10:23:47.434415+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.434415+0000', 'last_undegraded': '2024-05-08T10:23:47.434415+0000', 'last_fullsized': '2024-05-08T10:23:47.434415+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426210+0000', 'last_change': '2024-05-08T10:23:47.426210+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426210+0000', 'last_undegraded': '2024-05-08T10:23:47.426210+0000', 'last_fullsized': '2024-05-08T10:23:47.426210+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.431177+0000', 'last_change': '2024-05-08T10:23:47.431177+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.431177+0000', 'last_undegraded': '2024-05-08T10:23:47.431177+0000', 'last_fullsized': '2024-05-08T10:23:47.431177+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.433200+0000', 'last_change': '2024-05-08T10:23:47.433200+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.433200+0000', 'last_undegraded': '2024-05-08T10:23:47.433200+0000', 'last_fullsized': '2024-05-08T10:23:47.433200+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-05-08T10:23:52.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.430538+0000', 'last_change': '2024-05-08T10:23:47.430538+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.430538+0000', 'last_undegraded': '2024-05-08T10:23:47.430538+0000', 'last_fullsized': '2024-05-08T10:23:47.430538+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.428870+0000', 'last_change': '2024-05-08T10:23:47.428870+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.428870+0000', 'last_undegraded': '2024-05-08T10:23:47.428870+0000', 'last_fullsized': '2024-05-08T10:23:47.428870+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.432723+0000', 'last_change': '2024-05-08T10:23:47.432723+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.432723+0000', 'last_undegraded': '2024-05-08T10:23:47.432723+0000', 'last_fullsized': '2024-05-08T10:23:47.432723+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.425302+0000', 'last_change': '2024-05-08T10:23:47.425302+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.425302+0000', 'last_undegraded': '2024-05-08T10:23:47.425302+0000', 'last_fullsized': '2024-05-08T10:23:47.425302+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.427767+0000', 'last_change': '2024-05-08T10:23:47.427767+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.427767+0000', 'last_undegraded': '2024-05-08T10:23:47.427767+0000', 'last_fullsized': '2024-05-08T10:23:47.427767+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.431667+0000', 'last_change': '2024-05-08T10:23:47.431667+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.431667+0000', 'last_undegraded': '2024-05-08T10:23:47.431667+0000', 'last_fullsized': '2024-05-08T10:23:47.431667+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:23:52.115 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-05-08T10:23:52.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.423790+0000', 'last_change': '2024-05-08T10:23:47.423790+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.423790+0000', 'last_undegraded': '2024-05-08T10:23:47.423790+0000', 'last_fullsized': '2024-05-08T10:23:47.423790+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:23:52.116 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-05-08T10:23:52.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.426981+0000', 'last_change': '2024-05-08T10:23:47.426981+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.426981+0000', 'last_undegraded': '2024-05-08T10:23:47.426981+0000', 'last_fullsized': '2024-05-08T10:23:47.426981+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.116 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-05-08T10:23:52.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.430356+0000', 'last_change': '2024-05-08T10:23:47.430356+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.430356+0000', 'last_undegraded': '2024-05-08T10:23:47.430356+0000', 'last_fullsized': '2024-05-08T10:23:47.430356+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:23:52.116 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-05-08T10:23:52.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.425319+0000', 'last_change': '2024-05-08T10:23:47.425319+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.425319+0000', 'last_undegraded': '2024-05-08T10:23:47.425319+0000', 'last_fullsized': '2024-05-08T10:23:47.425319+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.116 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-05-08T10:23:52.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.428062+0000', 'last_change': '2024-05-08T10:23:47.428062+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.428062+0000', 'last_undegraded': '2024-05-08T10:23:47.428062+0000', 'last_fullsized': '2024-05-08T10:23:47.428062+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.117 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-05-08T10:23:52.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.423866+0000', 'last_change': '2024-05-08T10:23:47.423866+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.423866+0000', 'last_undegraded': '2024-05-08T10:23:47.423866+0000', 'last_fullsized': '2024-05-08T10:23:47.423866+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:23:52.117 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-05-08T10:23:52.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.425290+0000', 'last_change': '2024-05-08T10:23:47.425290+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.425290+0000', 'last_undegraded': '2024-05-08T10:23:47.425290+0000', 'last_fullsized': '2024-05-08T10:23:47.425290+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.117 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-05-08T10:23:52.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.425305+0000', 'last_change': '2024-05-08T10:23:47.425305+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.425305+0000', 'last_undegraded': '2024-05-08T10:23:47.425305+0000', 'last_fullsized': '2024-05-08T10:23:47.425305+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.427269+0000', 'last_change': '2024-05-08T10:23:47.427269+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.427269+0000', 'last_undegraded': '2024-05-08T10:23:47.427269+0000', 'last_fullsized': '2024-05-08T10:23:47.427269+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.427572+0000', 'last_change': '2024-05-08T10:23:47.427572+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.427572+0000', 'last_undegraded': '2024-05-08T10:23:47.427572+0000', 'last_fullsized': '2024-05-08T10:23:47.427572+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.429334+0000', 'last_change': '2024-05-08T10:23:47.429334+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.429334+0000', 'last_undegraded': '2024-05-08T10:23:47.429334+0000', 'last_fullsized': '2024-05-08T10:23:47.429334+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.429673+0000', 'last_change': '2024-05-08T10:23:47.429673+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.429673+0000', 'last_undegraded': '2024-05-08T10:23:47.429673+0000', 'last_fullsized': '2024-05-08T10:23:47.429673+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-05-08T10:23:52.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:23:47.425885+0000', 'last_change': '2024-05-08T10:23:47.425885+0000', 'last_active': '2024-05-08T10:23:47.415124+0000', 'last_peered': '2024-05-08T10:23:47.415124+0000', 'last_clean': '2024-05-08T10:23:47.415124+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:23:47.425885+0000', 'last_undegraded': '2024-05-08T10:23:47.425885+0000', 'last_fullsized': '2024-05-08T10:23:47.425885+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'last_clean_scrub_stamp': '2024-05-08T10:23:47.415124+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:23:52.119 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-08T10:23:52.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.255+0000 7fb29bada640 1 Processor -- start 2024-05-08T10:23:52.242 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.255+0000 7fb29bada640 1 -- start start 2024-05-08T10:23:52.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.256+0000 7fb29bada640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb294159a30 0x7fb2940b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.256+0000 7fb29bada640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb294159e10 0x7fb29406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.256+0000 7fb29bada640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb29406d870 0x7fb2941631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.256+0000 7fb29bada640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb29415ffc0 con 0x7fb294159a30 2024-05-08T10:23:52.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.256+0000 7fb29bada640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb2941602a0 con 0x7fb294159e10 2024-05-08T10:23:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.256+0000 7fb29bada640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb294160580 con 0x7fb29406d870 2024-05-08T10:23:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.256+0000 7fb299876640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb294159a30 0x7fb2940b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.256+0000 7fb299876640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb294159a30 0x7fb2940b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58790/0 (socket says 172.21.15.143:58790) 2024-05-08T10:23:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.256+0000 7fb299876640 1 -- 172.21.15.143:0/3825846343 learned_addr learned my addr 172.21.15.143:0/3825846343 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.257+0000 7fb29a077640 1 --2- 172.21.15.143:0/3825846343 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb29406d870 0x7fb2941631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.257+0000 7fb299876640 1 -- 172.21.15.143:0/3825846343 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb29406d870 msgr2=0x7fb2941631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:52.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.257+0000 7fb299075640 1 --2- 172.21.15.143:0/3825846343 >> v2:172.21.15.163:3300/0 conn(0x7fb294159e10 0x7fb29406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.257+0000 7fb299876640 1 --2- 172.21.15.143:0/3825846343 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb29406d870 0x7fb2941631d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.257+0000 7fb299876640 1 -- 172.21.15.143:0/3825846343 >> v2:172.21.15.163:3300/0 conn(0x7fb294159e10 msgr2=0x7fb29406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:52.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.257+0000 7fb299876640 1 --2- 172.21.15.143:0/3825846343 >> v2:172.21.15.163:3300/0 conn(0x7fb294159e10 0x7fb29406d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.257+0000 7fb299876640 1 -- 172.21.15.143:0/3825846343 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb294160860 con 0x7fb294159a30 2024-05-08T10:23:52.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.257+0000 7fb29a077640 1 --2- 172.21.15.143:0/3825846343 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb29406d870 0x7fb2941631d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb299876640 1 --2- 172.21.15.143:0/3825846343 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb294159a30 0x7fb2940b4960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb294071750 tx=0x7fb28402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7d27dc3b95774b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb298874640 1 -- 172.21.15.143:0/3825846343 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284036070 con 0x7fb294159a30 2024-05-08T10:23:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb298874640 1 -- 172.21.15.143:0/3825846343 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb284031600 con 0x7fb294159a30 2024-05-08T10:23:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb298874640 1 -- 172.21.15.143:0/3825846343 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2840319d0 con 0x7fb294159a30 2024-05-08T10:23:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb29bada640 1 -- 172.21.15.143:0/3825846343 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb294159a30 msgr2=0x7fb2940b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb29bada640 1 --2- 172.21.15.143:0/3825846343 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb294159a30 0x7fb2940b4960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb294071750 tx=0x7fb28402a570 comp rx=0 tx=0).stop 2024-05-08T10:23:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb29bada640 1 -- 172.21.15.143:0/3825846343 shutdown_connections 2024-05-08T10:23:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb29bada640 1 --2- 172.21.15.143:0/3825846343 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb29406d870 0x7fb2941631d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb29bada640 1 --2- 172.21.15.143:0/3825846343 >> v2:172.21.15.163:3300/0 conn(0x7fb294159e10 0x7fb29406d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb29bada640 1 --2- 172.21.15.143:0/3825846343 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb294159a30 0x7fb2940b4960 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.258+0000 7fb29bada640 1 -- 172.21.15.143:0/3825846343 >> 172.21.15.143:0/3825846343 conn(0x7fb294072bd0 msgr2=0x7fb294072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.259+0000 7fb29bada640 1 -- 172.21.15.143:0/3825846343 shutdown_connections 2024-05-08T10:23:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.259+0000 7fb29bada640 1 -- 172.21.15.143:0/3825846343 wait complete. 2024-05-08T10:23:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb29bada640 1 Processor -- start 2024-05-08T10:23:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb29bada640 1 -- start start 2024-05-08T10:23:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb29bada640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb29406d870 0x7fb294158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb29bada640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb294159a30 0x7fb29415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb29bada640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb294159e10 0x7fb2941559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb29bada640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb2940b5020 con 0x7fb29406d870 2024-05-08T10:23:52.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb29bada640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb2940b4ea0 con 0x7fb294159e10 2024-05-08T10:23:52.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb29bada640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb294163710 con 0x7fb294159a30 2024-05-08T10:23:52.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb299876640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb29406d870 0x7fb294158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb299876640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb29406d870 0x7fb294158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58798/0 (socket says 172.21.15.143:58798) 2024-05-08T10:23:52.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.260+0000 7fb299876640 1 -- 172.21.15.143:0/704313883 learned_addr learned my addr 172.21.15.143:0/704313883 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:52.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb29a077640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb294159e10 0x7fb2941559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb299075640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb294159a30 0x7fb29415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb299876640 1 -- 172.21.15.143:0/704313883 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb294159a30 msgr2=0x7fb29415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb299876640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb294159a30 0x7fb29415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb299876640 1 -- 172.21.15.143:0/704313883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb294159e10 msgr2=0x7fb2941559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb299876640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb294159e10 0x7fb2941559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb299876640 1 -- 172.21.15.143:0/704313883 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2941579f0 con 0x7fb29406d870 2024-05-08T10:23:52.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb299075640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb294159a30 0x7fb29415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb299876640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb29406d870 0x7fb294158a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb284034040 tx=0x7fb284004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb2927fc640 1 -- 172.21.15.143:0/704313883 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284036050 con 0x7fb29406d870 2024-05-08T10:23:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb2927fc640 1 -- 172.21.15.143:0/704313883 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb284042070 con 0x7fb29406d870 2024-05-08T10:23:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb2927fc640 1 -- 172.21.15.143:0/704313883 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284007c30 con 0x7fb29406d870 2024-05-08T10:23:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb294157cd0 con 0x7fb29406d870 2024-05-08T10:23:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.261+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb294158290 con 0x7fb29406d870 2024-05-08T10:23:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.262+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb294068920 con 0x7fb29406d870 2024-05-08T10:23:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.263+0000 7fb2927fc640 1 -- 172.21.15.143:0/704313883 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb284047460 con 0x7fb29406d870 2024-05-08T10:23:52.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.263+0000 7fb2927fc640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb2800762d0 0x7fb280078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.260 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.263+0000 7fb2927fc640 1 -- 172.21.15.143:0/704313883 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb2840b84e0 con 0x7fb29406d870 2024-05-08T10:23:52.260 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.263+0000 7fb299075640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb2800762d0 0x7fb280078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.260 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.264+0000 7fb299075640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb2800762d0 0x7fb280078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb2940d1820 tx=0x7fb288008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:52.260 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.267+0000 7fb2927fc640 1 -- 172.21.15.143:0/704313883 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb284081ed0 con 0x7fb29406d870 2024-05-08T10:23:52.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.522+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb29406a4b0 con 0x7fb29406d870 2024-05-08T10:23:52.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.523+0000 7fb2927fc640 1 -- 172.21.15.143:0/704313883 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1032 (secure 0 0 0) 0x7fb2840817d0 con 0x7fb29406d870 2024-05-08T10:23:52.509 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:52.510 INFO:teuthology.orchestra.run.smithi143.stdout:{"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":20,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1715163822,"num_in_osds":8,"osd_in_since":1715163814,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224473088,"bytes_avail":772869640192,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4263}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-08T10:23:32.148828+0000","services":{}},"progress_events":{}} 2024-05-08T10:23:52.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb2800762d0 msgr2=0x7fb280078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb2800762d0 0x7fb280078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb2940d1820 tx=0x7fb288008040 comp rx=0 tx=0).stop 2024-05-08T10:23:52.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb29406d870 msgr2=0x7fb294158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb29406d870 0x7fb294158a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb284034040 tx=0x7fb284004a40 comp rx=0 tx=0).stop 2024-05-08T10:23:52.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 shutdown_connections 2024-05-08T10:23:52.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb294159e10 0x7fb2941559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb294159a30 0x7fb29415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb2800762d0 0x7fb280078790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 --2- 172.21.15.143:0/704313883 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb29406d870 0x7fb294158a90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 >> 172.21.15.143:0/704313883 conn(0x7fb294072bd0 msgr2=0x7fb29415f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:52.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 shutdown_connections 2024-05-08T10:23:52.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.525+0000 7fb29bada640 1 -- 172.21.15.143:0/704313883 wait complete. 2024-05-08T10:23:52.522 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-08T10:23:52.523 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:23:52.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.637+0000 7f2d10615640 1 Processor -- start 2024-05-08T10:23:52.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.637+0000 7f2d10615640 1 -- start start 2024-05-08T10:23:52.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d10615640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2d08142390 0x7f2d080b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d10615640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d080b65e0 0x7f2d08162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d10615640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d08142770 con 0x7f2d08163500 2024-05-08T10:23:52.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d10615640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2d080b6a40 con 0x7f2d08142390 2024-05-08T10:23:52.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d10615640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2d08143a80 con 0x7f2d080b65e0 2024-05-08T10:23:52.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0ebb2640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f2d08163500 0x7f2d08071db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54254/0 (socket says 172.21.15.143:54254) 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0ebb2640 1 -- 172.21.15.143:0/2772753483 learned_addr learned my addr 172.21.15.143:0/2772753483 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0e3b1640 1 --2- 172.21.15.143:0/2772753483 >> v2:172.21.15.163:3300/0 conn(0x7f2d08142390 0x7f2d080b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0dbb0640 1 --2- 172.21.15.143:0/2772753483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d080b65e0 0x7f2d08162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0d3af640 1 -- 172.21.15.143:0/2772753483 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994145909 0 0) 0x7f2d08142770 con 0x7f2d08163500 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0d3af640 1 -- 172.21.15.143:0/2772753483 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cf4003520 con 0x7f2d08163500 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0d3af640 1 -- 172.21.15.143:0/2772753483 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3183261823 0 0) 0x7f2cf4003520 con 0x7f2d08163500 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0e3b1640 1 -- 172.21.15.143:0/2772753483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d080b65e0 msgr2=0x7f2d08162fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0e3b1640 1 --2- 172.21.15.143:0/2772753483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d080b65e0 0x7f2d08162fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0e3b1640 1 -- 172.21.15.143:0/2772753483 >> v1:172.21.15.143:6789/0 conn(0x7f2d08163500 legacy=0x7f2d08071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0e3b1640 1 -- 172.21.15.143:0/2772753483 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d08163d30 con 0x7f2d08142390 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.638+0000 7f2d0dbb0640 1 --2- 172.21.15.143:0/2772753483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d080b65e0 0x7f2d08162fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:52.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.639+0000 7f2d0e3b1640 1 --2- 172.21.15.143:0/2772753483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d08142390 0x7f2d080b60a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0097a0 tx=0x7f2cfc02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5182ee230fb61953 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.639+0000 7f2d0d3af640 1 -- 172.21.15.143:0/2772753483 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc037070 con 0x7f2d08142390 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.639+0000 7f2d0d3af640 1 -- 172.21.15.143:0/2772753483 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc02aba0 con 0x7f2d08142390 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.639+0000 7f2d0d3af640 1 -- 172.21.15.143:0/2772753483 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00001a70 con 0x7f2d08142390 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.640+0000 7f2d10615640 1 -- 172.21.15.143:0/2772753483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d08142390 msgr2=0x7f2d080b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.640+0000 7f2d10615640 1 --2- 172.21.15.143:0/2772753483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d08142390 0x7f2d080b60a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0097a0 tx=0x7f2cfc02a110 comp rx=0 tx=0).stop 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.640+0000 7f2d10615640 1 -- 172.21.15.143:0/2772753483 shutdown_connections 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.640+0000 7f2d10615640 1 --2- 172.21.15.143:0/2772753483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d080b65e0 0x7f2d08162fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.640+0000 7f2d10615640 1 --2- 172.21.15.143:0/2772753483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d08142390 0x7f2d080b60a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.640+0000 7f2d10615640 1 -- 172.21.15.143:0/2772753483 >> 172.21.15.143:0/2772753483 conn(0x7f2d080b4da0 msgr2=0x7f2d080b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.640+0000 7f2d10615640 1 -- 172.21.15.143:0/2772753483 shutdown_connections 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.640+0000 7f2d10615640 1 -- 172.21.15.143:0/2772753483 wait complete. 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.641+0000 7f2d10615640 1 Processor -- start 2024-05-08T10:23:52.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.641+0000 7f2d10615640 1 -- start start 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d10615640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d080b65e0 0x7f2d08145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d10615640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d08142390 0x7f2d080cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d10615640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d08163500 0x7f2d0815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d10615640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0815ff50 con 0x7f2d08163500 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d10615640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0815fc70 con 0x7f2d080b65e0 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d10615640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2d08160230 con 0x7f2d08142390 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0ebb2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d08163500 0x7f2d0815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0ebb2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d08163500 0x7f2d0815e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58808/0 (socket says 172.21.15.143:58808) 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0ebb2640 1 -- 172.21.15.143:0/4222547049 learned_addr learned my addr 172.21.15.143:0/4222547049 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0e3b1640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d080b65e0 0x7f2d08145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0dbb0640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d08142390 0x7f2d080cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0ebb2640 1 -- 172.21.15.143:0/4222547049 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d08142390 msgr2=0x7f2d080cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0ebb2640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d08142390 0x7f2d080cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0ebb2640 1 -- 172.21.15.143:0/4222547049 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d080b65e0 msgr2=0x7f2d08145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0ebb2640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d080b65e0 0x7f2d08145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0ebb2640 1 -- 172.21.15.143:0/4222547049 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d080cd370 con 0x7f2d08163500 2024-05-08T10:23:52.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d0ebb2640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d08163500 0x7f2d0815e890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000cbf0 tx=0x7f2d0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:52.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2cfaffd640 1 -- 172.21.15.143:0/4222547049 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00017070 con 0x7f2d08163500 2024-05-08T10:23:52.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2cfaffd640 1 -- 172.21.15.143:0/4222547049 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0000ad50 con 0x7f2d08163500 2024-05-08T10:23:52.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d081598b0 con 0x7f2d08163500 2024-05-08T10:23:52.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2cfaffd640 1 -- 172.21.15.143:0/4222547049 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00012620 con 0x7f2d08163500 2024-05-08T10:23:52.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.642+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0815a150 con 0x7f2d08163500 2024-05-08T10:23:52.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.643+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d08075dc0 con 0x7f2d08163500 2024-05-08T10:23:52.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.644+0000 7f2cfaffd640 1 -- 172.21.15.143:0/4222547049 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d0001a070 con 0x7f2d08163500 2024-05-08T10:23:52.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.644+0000 7f2cfaffd640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cec0762d0 0x7f2cec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:52.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.644+0000 7f2d0e3b1640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cec0762d0 0x7f2cec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:52.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.644+0000 7f2cfaffd640 1 -- 172.21.15.143:0/4222547049 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d00097420 con 0x7f2d08163500 2024-05-08T10:23:52.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.645+0000 7f2d0e3b1640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cec0762d0 0x7f2cec078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc034000 tx=0x7f2cfc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:52.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.650+0000 7f2cfaffd640 1 -- 172.21.15.143:0/4222547049 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2d00060730 con 0x7f2d08163500 2024-05-08T10:23:52.752 INFO:tasks.ceph.mds.a.smithi143.stderr:2024-05-08T10:23:52.766+0000 7fbbf121d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T10:23:52.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.827+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d0813e5c0 con 0x7f2cec0762d0 2024-05-08T10:23:52.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.833+0000 7f2cfaffd640 1 -- 172.21.15.143:0/4222547049 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246613 (secure 0 0 0) 0x7f2d0813e5c0 con 0x7f2cec0762d0 2024-05-08T10:23:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:52.823 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:23:52.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cec0762d0 msgr2=0x7f2cec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.825 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cec0762d0 0x7f2cec078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc034000 tx=0x7f2cfc02e000 comp rx=0 tx=0).stop 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d08163500 msgr2=0x7f2d0815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d08163500 0x7f2d0815e890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000cbf0 tx=0x7f2d0000a430 comp rx=0 tx=0).stop 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 shutdown_connections 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cec0762d0 0x7f2cec078790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d08163500 0x7f2d0815e890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2d08142390 0x7f2d080cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 --2- 172.21.15.143:0/4222547049 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d080b65e0 0x7f2d08145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 >> 172.21.15.143:0/4222547049 conn(0x7f2d080b4da0 msgr2=0x7f2d080b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 shutdown_connections 2024-05-08T10:23:52.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:52.837+0000 7f2d10615640 1 -- 172.21.15.143:0/4222547049 wait complete. 2024-05-08T10:23:52.834 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-08T10:23:52.525210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":2508,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":2568192,"data_stored":1612233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.101277"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431662+0000","last_change":"2024-05-08T10:23:47.431662+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431662+0000","last_undegraded":"2024-05-08T10:23:47.431662+0000","last_fullsized":"2024-05-08T10:23:47.431662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431196+0000","last_change":"2024-05-08T10:23:47.431196+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431196+0000","last_undegraded":"2024-05-08T10:23:47.431196+0000","last_fullsized":"2024-05-08T10:23:47.431196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427104+0000","last_change":"2024-05-08T10:23:47.427104+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427104+0000","last_undegraded":"2024-05-08T10:23:47.427104+0000","last_fullsized":"2024-05-08T10:23:47.427104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429800+0000","last_change":"2024-05-08T10:23:47.429800+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429800+0000","last_undegraded":"2024-05-08T10:23:47.429800+0000","last_fullsized":"2024-05-08T10:23:47.429800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.435270+0000","last_change":"2024-05-08T10:23:47.435270+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.435270+0000","last_undegraded":"2024-05-08T10:23:47.435270+0000","last_fullsized":"2024-05-08T10:23:47.435270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433166+0000","last_change":"2024-05-08T10:23:47.433166+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433166+0000","last_undegraded":"2024-05-08T10:23:47.433166+0000","last_fullsized":"2024-05-08T10:23:47.433166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431815+0000","last_change":"2024-05-08T10:23:47.431815+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431815+0000","last_undegraded":"2024-05-08T10:23:47.431815+0000","last_fullsized":"2024-05-08T10:23:47.431815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426758+0000","last_change":"2024-05-08T10:23:47.426758+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426758+0000","last_undegraded":"2024-05-08T10:23:47.426758+0000","last_fullsized":"2024-05-08T10:23:47.426758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431039+0000","last_change":"2024-05-08T10:23:47.431039+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431039+0000","last_undegraded":"2024-05-08T10:23:47.431039+0000","last_fullsized":"2024-05-08T10:23:47.431039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428458+0000","last_change":"2024-05-08T10:23:47.428458+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428458+0000","last_undegraded":"2024-05-08T10:23:47.428458+0000","last_fullsized":"2024-05-08T10:23:47.428458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426526+0000","last_change":"2024-05-08T10:23:47.426526+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426526+0000","last_undegraded":"2024-05-08T10:23:47.426526+0000","last_fullsized":"2024-05-08T10:23:47.426526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425230+0000","last_change":"2024-05-08T10:23:47.425230+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425230+0000","last_undegraded":"2024-05-08T10:23:47.425230+0000","last_fullsized":"2024-05-08T10:23:47.425230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426133+0000","last_change":"2024-05-08T10:23:47.426133+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426133+0000","last_undegraded":"2024-05-08T10:23:47.426133+0000","last_fullsized":"2024-05-08T10:23:47.426133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429210+0000","last_change":"2024-05-08T10:23:47.429210+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429210+0000","last_undegraded":"2024-05-08T10:23:47.429210+0000","last_fullsized":"2024-05-08T10:23:47.429210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431289+0000","last_change":"2024-05-08T10:23:47.431289+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431289+0000","last_undegraded":"2024-05-08T10:23:47.431289+0000","last_fullsized":"2024-05-08T10:23:47.431289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430746+0000","last_change":"2024-05-08T10:23:47.430746+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430746+0000","last_undegraded":"2024-05-08T10:23:47.430746+0000","last_fullsized":"2024-05-08T10:23:47.430746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426764+0000","last_change":"2024-05-08T10:23:47.426764+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426764+0000","last_undegraded":"2024-05-08T10:23:47.426764+0000","last_fullsized":"2024-05-08T10:23:47.426764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.422801+0000","last_change":"2024-05-08T10:23:47.422801+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.422801+0000","last_undegraded":"2024-05-08T10:23:47.422801+0000","last_fullsized":"2024-05-08T10:23:47.422801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430500+0000","last_change":"2024-05-08T10:23:47.430500+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430500+0000","last_undegraded":"2024-05-08T10:23:47.430500+0000","last_fullsized":"2024-05-08T10:23:47.430500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426934+0000","last_change":"2024-05-08T10:23:47.426934+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426934+0000","last_undegraded":"2024-05-08T10:23:47.426934+0000","last_fullsized":"2024-05-08T10:23:47.426934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430150+0000","last_change":"2024-05-08T10:23:47.430150+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430150+0000","last_undegraded":"2024-05-08T10:23:47.430150+0000","last_fullsized":"2024-05-08T10:23:47.430150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432262+0000","last_change":"2024-05-08T10:23:47.432262+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432262+0000","last_undegraded":"2024-05-08T10:23:47.432262+0000","last_fullsized":"2024-05-08T10:23:47.432262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426116+0000","last_change":"2024-05-08T10:23:47.426116+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426116+0000","last_undegraded":"2024-05-08T10:23:47.426116+0000","last_fullsized":"2024-05-08T10:23:47.426116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430285+0000","last_change":"2024-05-08T10:23:47.430285+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430285+0000","last_undegraded":"2024-05-08T10:23:47.430285+0000","last_fullsized":"2024-05-08T10:23:47.430285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426086+0000","last_change":"2024-05-08T10:23:47.426086+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426086+0000","last_undegraded":"2024-05-08T10:23:47.426086+0000","last_fullsized":"2024-05-08T10:23:47.426086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426748+0000","last_change":"2024-05-08T10:23:47.426748+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426748+0000","last_undegraded":"2024-05-08T10:23:47.426748+0000","last_fullsized":"2024-05-08T10:23:47.426748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431014+0000","last_change":"2024-05-08T10:23:47.431014+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431014+0000","last_undegraded":"2024-05-08T10:23:47.431014+0000","last_fullsized":"2024-05-08T10:23:47.431014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426126+0000","last_change":"2024-05-08T10:23:47.426126+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426126+0000","last_undegraded":"2024-05-08T10:23:47.426126+0000","last_fullsized":"2024-05-08T10:23:47.426126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429756+0000","last_change":"2024-05-08T10:23:47.429756+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429756+0000","last_undegraded":"2024-05-08T10:23:47.429756+0000","last_fullsized":"2024-05-08T10:23:47.429756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431739+0000","last_change":"2024-05-08T10:23:47.431739+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431739+0000","last_undegraded":"2024-05-08T10:23:47.431739+0000","last_fullsized":"2024-05-08T10:23:47.431739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423041+0000","last_change":"2024-05-08T10:23:47.423041+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423041+0000","last_undegraded":"2024-05-08T10:23:47.423041+0000","last_fullsized":"2024-05-08T10:23:47.423041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428027+0000","last_change":"2024-05-08T10:23:47.428027+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428027+0000","last_undegraded":"2024-05-08T10:23:47.428027+0000","last_fullsized":"2024-05-08T10:23:47.428027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423709+0000","last_change":"2024-05-08T10:23:47.423709+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423709+0000","last_undegraded":"2024-05-08T10:23:47.423709+0000","last_fullsized":"2024-05-08T10:23:47.423709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443494+0000","last_change":"2024-05-08T10:23:47.440565+0000","last_active":"2024-05-08T10:23:47.443494+0000","last_peered":"2024-05-08T10:23:47.443494+0000","last_clean":"2024-05-08T10:23:47.443494+0000","last_became_active":"2024-05-08T10:23:47.440296+0000","last_became_peered":"2024-05-08T10:23:47.440296+0000","last_unstale":"2024-05-08T10:23:47.443494+0000","last_undegraded":"2024-05-08T10:23:47.443494+0000","last_fullsized":"2024-05-08T10:23:47.443494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429282+0000","last_change":"2024-05-08T10:23:47.429282+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429282+0000","last_undegraded":"2024-05-08T10:23:47.429282+0000","last_fullsized":"2024-05-08T10:23:47.429282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.435127+0000","last_change":"2024-05-08T10:23:47.432111+0000","last_active":"2024-05-08T10:23:47.435127+0000","last_peered":"2024-05-08T10:23:47.435127+0000","last_clean":"2024-05-08T10:23:47.435127+0000","last_became_active":"2024-05-08T10:23:47.430756+0000","last_became_peered":"2024-05-08T10:23:47.430756+0000","last_unstale":"2024-05-08T10:23:47.435127+0000","last_undegraded":"2024-05-08T10:23:47.435127+0000","last_fullsized":"2024-05-08T10:23:47.435127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.437909+0000","last_change":"2024-05-08T10:23:47.431893+0000","last_active":"2024-05-08T10:23:47.437909+0000","last_peered":"2024-05-08T10:23:47.437909+0000","last_clean":"2024-05-08T10:23:47.437909+0000","last_became_active":"2024-05-08T10:23:47.431613+0000","last_became_peered":"2024-05-08T10:23:47.431613+0000","last_unstale":"2024-05-08T10:23:47.437909+0000","last_undegraded":"2024-05-08T10:23:47.437909+0000","last_fullsized":"2024-05-08T10:23:47.437909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425824+0000","last_change":"2024-05-08T10:23:47.425824+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425824+0000","last_undegraded":"2024-05-08T10:23:47.425824+0000","last_fullsized":"2024-05-08T10:23:47.425824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.438599+0000","last_change":"2024-05-08T10:23:47.436762+0000","last_active":"2024-05-08T10:23:47.438599+0000","last_peered":"2024-05-08T10:23:47.438599+0000","last_clean":"2024-05-08T10:23:47.438599+0000","last_became_active":"2024-05-08T10:23:47.436442+0000","last_became_peered":"2024-05-08T10:23:47.436442+0000","last_unstale":"2024-05-08T10:23:47.438599+0000","last_undegraded":"2024-05-08T10:23:47.438599+0000","last_fullsized":"2024-05-08T10:23:47.438599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432795+0000","last_change":"2024-05-08T10:23:47.432795+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432795+0000","last_undegraded":"2024-05-08T10:23:47.432795+0000","last_fullsized":"2024-05-08T10:23:47.432795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440383+0000","last_change":"2024-05-08T10:23:47.439183+0000","last_active":"2024-05-08T10:23:47.440383+0000","last_peered":"2024-05-08T10:23:47.440383+0000","last_clean":"2024-05-08T10:23:47.440383+0000","last_became_active":"2024-05-08T10:23:47.438842+0000","last_became_peered":"2024-05-08T10:23:47.438842+0000","last_unstale":"2024-05-08T10:23:47.440383+0000","last_undegraded":"2024-05-08T10:23:47.440383+0000","last_fullsized":"2024-05-08T10:23:47.440383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432457+0000","last_change":"2024-05-08T10:23:47.432457+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432457+0000","last_undegraded":"2024-05-08T10:23:47.432457+0000","last_fullsized":"2024-05-08T10:23:47.432457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447345+0000","last_change":"2024-05-08T10:23:47.442360+0000","last_active":"2024-05-08T10:23:47.447345+0000","last_peered":"2024-05-08T10:23:47.447345+0000","last_clean":"2024-05-08T10:23:47.447345+0000","last_became_active":"2024-05-08T10:23:47.442107+0000","last_became_peered":"2024-05-08T10:23:47.442107+0000","last_unstale":"2024-05-08T10:23:47.447345+0000","last_undegraded":"2024-05-08T10:23:47.447345+0000","last_fullsized":"2024-05-08T10:23:47.447345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429162+0000","last_change":"2024-05-08T10:23:47.429162+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429162+0000","last_undegraded":"2024-05-08T10:23:47.429162+0000","last_fullsized":"2024-05-08T10:23:47.429162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440894+0000","last_change":"2024-05-08T10:23:47.438561+0000","last_active":"2024-05-08T10:23:47.440894+0000","last_peered":"2024-05-08T10:23:47.440894+0000","last_clean":"2024-05-08T10:23:47.440894+0000","last_became_active":"2024-05-08T10:23:47.437710+0000","last_became_peered":"2024-05-08T10:23:47.437710+0000","last_unstale":"2024-05-08T10:23:47.440894+0000","last_undegraded":"2024-05-08T10:23:47.440894+0000","last_fullsized":"2024-05-08T10:23:47.440894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.424002+0000","last_change":"2024-05-08T10:23:47.424002+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.424002+0000","last_undegraded":"2024-05-08T10:23:47.424002+0000","last_fullsized":"2024-05-08T10:23:47.424002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440316+0000","last_change":"2024-05-08T10:23:47.436584+0000","last_active":"2024-05-08T10:23:47.440316+0000","last_peered":"2024-05-08T10:23:47.440316+0000","last_clean":"2024-05-08T10:23:47.440316+0000","last_became_active":"2024-05-08T10:23:47.436126+0000","last_became_peered":"2024-05-08T10:23:47.436126+0000","last_unstale":"2024-05-08T10:23:47.440316+0000","last_undegraded":"2024-05-08T10:23:47.440316+0000","last_fullsized":"2024-05-08T10:23:47.440316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433327+0000","last_change":"2024-05-08T10:23:47.433327+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433327+0000","last_undegraded":"2024-05-08T10:23:47.433327+0000","last_fullsized":"2024-05-08T10:23:47.433327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440924+0000","last_change":"2024-05-08T10:23:47.435055+0000","last_active":"2024-05-08T10:23:47.440924+0000","last_peered":"2024-05-08T10:23:47.440924+0000","last_clean":"2024-05-08T10:23:47.440924+0000","last_became_active":"2024-05-08T10:23:47.434642+0000","last_became_peered":"2024-05-08T10:23:47.434642+0000","last_unstale":"2024-05-08T10:23:47.440924+0000","last_undegraded":"2024-05-08T10:23:47.440924+0000","last_fullsized":"2024-05-08T10:23:47.440924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:52.768923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427182+0000","last_change":"2024-05-08T10:23:47.427182+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427182+0000","last_undegraded":"2024-05-08T10:23:47.427182+0000","last_fullsized":"2024-05-08T10:23:47.427182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440954+0000","last_change":"2024-05-08T10:23:47.437417+0000","last_active":"2024-05-08T10:23:47.440954+0000","last_peered":"2024-05-08T10:23:47.440954+0000","last_clean":"2024-05-08T10:23:47.440954+0000","last_became_active":"2024-05-08T10:23:47.437129+0000","last_became_peered":"2024-05-08T10:23:47.437129+0000","last_unstale":"2024-05-08T10:23:47.440954+0000","last_undegraded":"2024-05-08T10:23:47.440954+0000","last_fullsized":"2024-05-08T10:23:47.440954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.434415+0000","last_change":"2024-05-08T10:23:47.434415+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.434415+0000","last_undegraded":"2024-05-08T10:23:47.434415+0000","last_fullsized":"2024-05-08T10:23:47.434415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.439691+0000","last_change":"2024-05-08T10:23:47.432460+0000","last_active":"2024-05-08T10:23:47.439691+0000","last_peered":"2024-05-08T10:23:47.439691+0000","last_clean":"2024-05-08T10:23:47.439691+0000","last_became_active":"2024-05-08T10:23:47.432156+0000","last_became_peered":"2024-05-08T10:23:47.432156+0000","last_unstale":"2024-05-08T10:23:47.439691+0000","last_undegraded":"2024-05-08T10:23:47.439691+0000","last_fullsized":"2024-05-08T10:23:47.439691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426210+0000","last_change":"2024-05-08T10:23:47.426210+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426210+0000","last_undegraded":"2024-05-08T10:23:47.426210+0000","last_fullsized":"2024-05-08T10:23:47.426210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443217+0000","last_change":"2024-05-08T10:23:47.439271+0000","last_active":"2024-05-08T10:23:47.443217+0000","last_peered":"2024-05-08T10:23:47.443217+0000","last_clean":"2024-05-08T10:23:47.443217+0000","last_became_active":"2024-05-08T10:23:47.438952+0000","last_became_peered":"2024-05-08T10:23:47.438952+0000","last_unstale":"2024-05-08T10:23:47.443217+0000","last_undegraded":"2024-05-08T10:23:47.443217+0000","last_fullsized":"2024-05-08T10:23:47.443217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431177+0000","last_change":"2024-05-08T10:23:47.431177+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431177+0000","last_undegraded":"2024-05-08T10:23:47.431177+0000","last_fullsized":"2024-05-08T10:23:47.431177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.439100+0000","last_change":"2024-05-08T10:23:47.436054+0000","last_active":"2024-05-08T10:23:47.439100+0000","last_peered":"2024-05-08T10:23:47.439100+0000","last_clean":"2024-05-08T10:23:47.439100+0000","last_became_active":"2024-05-08T10:23:47.435777+0000","last_became_peered":"2024-05-08T10:23:47.435777+0000","last_unstale":"2024-05-08T10:23:47.439100+0000","last_undegraded":"2024-05-08T10:23:47.439100+0000","last_fullsized":"2024-05-08T10:23:47.439100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.433200+0000","last_change":"2024-05-08T10:23:47.433200+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.433200+0000","last_undegraded":"2024-05-08T10:23:47.433200+0000","last_fullsized":"2024-05-08T10:23:47.433200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.434894+0000","last_change":"2024-05-08T10:23:47.428146+0000","last_active":"2024-05-08T10:23:47.434894+0000","last_peered":"2024-05-08T10:23:47.434894+0000","last_clean":"2024-05-08T10:23:47.434894+0000","last_became_active":"2024-05-08T10:23:47.427826+0000","last_became_peered":"2024-05-08T10:23:47.427826+0000","last_unstale":"2024-05-08T10:23:47.434894+0000","last_undegraded":"2024-05-08T10:23:47.434894+0000","last_fullsized":"2024-05-08T10:23:47.434894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430538+0000","last_change":"2024-05-08T10:23:47.430538+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430538+0000","last_undegraded":"2024-05-08T10:23:47.430538+0000","last_fullsized":"2024-05-08T10:23:47.430538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440876+0000","last_change":"2024-05-08T10:23:47.438474+0000","last_active":"2024-05-08T10:23:47.440876+0000","last_peered":"2024-05-08T10:23:47.440876+0000","last_clean":"2024-05-08T10:23:47.440876+0000","last_became_active":"2024-05-08T10:23:47.437999+0000","last_became_peered":"2024-05-08T10:23:47.437999+0000","last_unstale":"2024-05-08T10:23:47.440876+0000","last_undegraded":"2024-05-08T10:23:47.440876+0000","last_fullsized":"2024-05-08T10:23:47.440876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428870+0000","last_change":"2024-05-08T10:23:47.428870+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428870+0000","last_undegraded":"2024-05-08T10:23:47.428870+0000","last_fullsized":"2024-05-08T10:23:47.428870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440677+0000","last_change":"2024-05-08T10:23:47.437314+0000","last_active":"2024-05-08T10:23:47.440677+0000","last_peered":"2024-05-08T10:23:47.440677+0000","last_clean":"2024-05-08T10:23:47.440677+0000","last_became_active":"2024-05-08T10:23:47.436966+0000","last_became_peered":"2024-05-08T10:23:47.436966+0000","last_unstale":"2024-05-08T10:23:47.440677+0000","last_undegraded":"2024-05-08T10:23:47.440677+0000","last_fullsized":"2024-05-08T10:23:47.440677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.432723+0000","last_change":"2024-05-08T10:23:47.432723+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.432723+0000","last_undegraded":"2024-05-08T10:23:47.432723+0000","last_fullsized":"2024-05-08T10:23:47.432723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.433995+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:23:47.433995+0000","last_peered":"2024-05-08T10:23:47.433995+0000","last_clean":"2024-05-08T10:23:47.433995+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:23:47.433995+0000","last_undegraded":"2024-05-08T10:23:47.433995+0000","last_fullsized":"2024-05-08T10:23:47.433995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.441755+0000","last_change":"2024-05-08T10:23:47.437924+0000","last_active":"2024-05-08T10:23:47.441755+0000","last_peered":"2024-05-08T10:23:47.441755+0000","last_clean":"2024-05-08T10:23:47.441755+0000","last_became_active":"2024-05-08T10:23:47.437630+0000","last_became_peered":"2024-05-08T10:23:47.437630+0000","last_unstale":"2024-05-08T10:23:47.441755+0000","last_undegraded":"2024-05-08T10:23:47.441755+0000","last_fullsized":"2024-05-08T10:23:47.441755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425302+0000","last_change":"2024-05-08T10:23:47.425302+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425302+0000","last_undegraded":"2024-05-08T10:23:47.425302+0000","last_fullsized":"2024-05-08T10:23:47.425302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447365+0000","last_change":"2024-05-08T10:23:47.442183+0000","last_active":"2024-05-08T10:23:47.447365+0000","last_peered":"2024-05-08T10:23:47.447365+0000","last_clean":"2024-05-08T10:23:47.447365+0000","last_became_active":"2024-05-08T10:23:47.441485+0000","last_became_peered":"2024-05-08T10:23:47.441485+0000","last_unstale":"2024-05-08T10:23:47.447365+0000","last_undegraded":"2024-05-08T10:23:47.447365+0000","last_fullsized":"2024-05-08T10:23:47.447365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427767+0000","last_change":"2024-05-08T10:23:47.427767+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427767+0000","last_undegraded":"2024-05-08T10:23:47.427767+0000","last_fullsized":"2024-05-08T10:23:47.427767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.434821+0000","last_change":"2024-05-08T10:23:47.426677+0000","last_active":"2024-05-08T10:23:47.434821+0000","last_peered":"2024-05-08T10:23:47.434821+0000","last_clean":"2024-05-08T10:23:47.434821+0000","last_became_active":"2024-05-08T10:23:47.426406+0000","last_became_peered":"2024-05-08T10:23:47.426406+0000","last_unstale":"2024-05-08T10:23:47.434821+0000","last_undegraded":"2024-05-08T10:23:47.434821+0000","last_fullsized":"2024-05-08T10:23:47.434821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.431667+0000","last_change":"2024-05-08T10:23:47.431667+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.431667+0000","last_undegraded":"2024-05-08T10:23:47.431667+0000","last_fullsized":"2024-05-08T10:23:47.431667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.444562+0000","last_change":"2024-05-08T10:23:47.440567+0000","last_active":"2024-05-08T10:23:47.444562+0000","last_peered":"2024-05-08T10:23:47.444562+0000","last_clean":"2024-05-08T10:23:47.444562+0000","last_became_active":"2024-05-08T10:23:47.440075+0000","last_became_peered":"2024-05-08T10:23:47.440075+0000","last_unstale":"2024-05-08T10:23:47.444562+0000","last_undegraded":"2024-05-08T10:23:47.444562+0000","last_fullsized":"2024-05-08T10:23:47.444562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423790+0000","last_change":"2024-05-08T10:23:47.423790+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423790+0000","last_undegraded":"2024-05-08T10:23:47.423790+0000","last_fullsized":"2024-05-08T10:23:47.423790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440915+0000","last_change":"2024-05-08T10:23:47.439238+0000","last_active":"2024-05-08T10:23:47.440915+0000","last_peered":"2024-05-08T10:23:47.440915+0000","last_clean":"2024-05-08T10:23:47.440915+0000","last_became_active":"2024-05-08T10:23:47.438965+0000","last_became_peered":"2024-05-08T10:23:47.438965+0000","last_unstale":"2024-05-08T10:23:47.440915+0000","last_undegraded":"2024-05-08T10:23:47.440915+0000","last_fullsized":"2024-05-08T10:23:47.440915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.426981+0000","last_change":"2024-05-08T10:23:47.426981+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.426981+0000","last_undegraded":"2024-05-08T10:23:47.426981+0000","last_fullsized":"2024-05-08T10:23:47.426981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447420+0000","last_change":"2024-05-08T10:23:47.443886+0000","last_active":"2024-05-08T10:23:47.447420+0000","last_peered":"2024-05-08T10:23:47.447420+0000","last_clean":"2024-05-08T10:23:47.447420+0000","last_became_active":"2024-05-08T10:23:47.443654+0000","last_became_peered":"2024-05-08T10:23:47.443654+0000","last_unstale":"2024-05-08T10:23:47.447420+0000","last_undegraded":"2024-05-08T10:23:47.447420+0000","last_fullsized":"2024-05-08T10:23:47.447420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.430356+0000","last_change":"2024-05-08T10:23:47.430356+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.430356+0000","last_undegraded":"2024-05-08T10:23:47.430356+0000","last_fullsized":"2024-05-08T10:23:47.430356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443418+0000","last_change":"2024-05-08T10:23:47.440367+0000","last_active":"2024-05-08T10:23:47.443418+0000","last_peered":"2024-05-08T10:23:47.443418+0000","last_clean":"2024-05-08T10:23:47.443418+0000","last_became_active":"2024-05-08T10:23:47.440098+0000","last_became_peered":"2024-05-08T10:23:47.440098+0000","last_unstale":"2024-05-08T10:23:47.443418+0000","last_undegraded":"2024-05-08T10:23:47.443418+0000","last_fullsized":"2024-05-08T10:23:47.443418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425319+0000","last_change":"2024-05-08T10:23:47.425319+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425319+0000","last_undegraded":"2024-05-08T10:23:47.425319+0000","last_fullsized":"2024-05-08T10:23:47.425319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447250+0000","last_change":"2024-05-08T10:23:47.441809+0000","last_active":"2024-05-08T10:23:47.447250+0000","last_peered":"2024-05-08T10:23:47.447250+0000","last_clean":"2024-05-08T10:23:47.447250+0000","last_became_active":"2024-05-08T10:23:47.441527+0000","last_became_peered":"2024-05-08T10:23:47.441527+0000","last_unstale":"2024-05-08T10:23:47.447250+0000","last_undegraded":"2024-05-08T10:23:47.447250+0000","last_fullsized":"2024-05-08T10:23:47.447250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.428062+0000","last_change":"2024-05-08T10:23:47.428062+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.428062+0000","last_undegraded":"2024-05-08T10:23:47.428062+0000","last_fullsized":"2024-05-08T10:23:47.428062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447416+0000","last_change":"2024-05-08T10:23:47.443969+0000","last_active":"2024-05-08T10:23:47.447416+0000","last_peered":"2024-05-08T10:23:47.447416+0000","last_clean":"2024-05-08T10:23:47.447416+0000","last_became_active":"2024-05-08T10:23:47.443699+0000","last_became_peered":"2024-05-08T10:23:47.443699+0000","last_unstale":"2024-05-08T10:23:47.447416+0000","last_undegraded":"2024-05-08T10:23:47.447416+0000","last_fullsized":"2024-05-08T10:23:47.447416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.423866+0000","last_change":"2024-05-08T10:23:47.423866+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.423866+0000","last_undegraded":"2024-05-08T10:23:47.423866+0000","last_fullsized":"2024-05-08T10:23:47.423866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443627+0000","last_change":"2024-05-08T10:23:47.441563+0000","last_active":"2024-05-08T10:23:47.443627+0000","last_peered":"2024-05-08T10:23:47.443627+0000","last_clean":"2024-05-08T10:23:47.443627+0000","last_became_active":"2024-05-08T10:23:47.441300+0000","last_became_peered":"2024-05-08T10:23:47.441300+0000","last_unstale":"2024-05-08T10:23:47.443627+0000","last_undegraded":"2024-05-08T10:23:47.443627+0000","last_fullsized":"2024-05-08T10:23:47.443627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425290+0000","last_change":"2024-05-08T10:23:47.425290+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425290+0000","last_undegraded":"2024-05-08T10:23:47.425290+0000","last_fullsized":"2024-05-08T10:23:47.425290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.440842+0000","last_change":"2024-05-08T10:23:47.438095+0000","last_active":"2024-05-08T10:23:47.440842+0000","last_peered":"2024-05-08T10:23:47.440842+0000","last_clean":"2024-05-08T10:23:47.440842+0000","last_became_active":"2024-05-08T10:23:47.437623+0000","last_became_peered":"2024-05-08T10:23:47.437623+0000","last_unstale":"2024-05-08T10:23:47.440842+0000","last_undegraded":"2024-05-08T10:23:47.440842+0000","last_fullsized":"2024-05-08T10:23:47.440842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425305+0000","last_change":"2024-05-08T10:23:47.425305+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425305+0000","last_undegraded":"2024-05-08T10:23:47.425305+0000","last_fullsized":"2024-05-08T10:23:47.425305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447360+0000","last_change":"2024-05-08T10:23:47.441909+0000","last_active":"2024-05-08T10:23:47.447360+0000","last_peered":"2024-05-08T10:23:47.447360+0000","last_clean":"2024-05-08T10:23:47.447360+0000","last_became_active":"2024-05-08T10:23:47.441503+0000","last_became_peered":"2024-05-08T10:23:47.441503+0000","last_unstale":"2024-05-08T10:23:47.447360+0000","last_undegraded":"2024-05-08T10:23:47.447360+0000","last_fullsized":"2024-05-08T10:23:47.447360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427269+0000","last_change":"2024-05-08T10:23:47.427269+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427269+0000","last_undegraded":"2024-05-08T10:23:47.427269+0000","last_fullsized":"2024-05-08T10:23:47.427269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.427572+0000","last_change":"2024-05-08T10:23:47.427572+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.427572+0000","last_undegraded":"2024-05-08T10:23:47.427572+0000","last_fullsized":"2024-05-08T10:23:47.427572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.444331+0000","last_change":"2024-05-08T10:23:47.439945+0000","last_active":"2024-05-08T10:23:47.444331+0000","last_peered":"2024-05-08T10:23:47.444331+0000","last_clean":"2024-05-08T10:23:47.444331+0000","last_became_active":"2024-05-08T10:23:47.439631+0000","last_became_peered":"2024-05-08T10:23:47.439631+0000","last_unstale":"2024-05-08T10:23:47.444331+0000","last_undegraded":"2024-05-08T10:23:47.444331+0000","last_fullsized":"2024-05-08T10:23:47.444331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429334+0000","last_change":"2024-05-08T10:23:47.429334+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429334+0000","last_undegraded":"2024-05-08T10:23:47.429334+0000","last_fullsized":"2024-05-08T10:23:47.429334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.447396+0000","last_change":"2024-05-08T10:23:47.442600+0000","last_active":"2024-05-08T10:23:47.447396+0000","last_peered":"2024-05-08T10:23:47.447396+0000","last_clean":"2024-05-08T10:23:47.447396+0000","last_became_active":"2024-05-08T10:23:47.441385+0000","last_became_peered":"2024-05-08T10:23:47.441385+0000","last_unstale":"2024-05-08T10:23:47.447396+0000","last_undegraded":"2024-05-08T10:23:47.447396+0000","last_fullsized":"2024-05-08T10:23:47.447396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.429673+0000","last_change":"2024-05-08T10:23:47.429673+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.429673+0000","last_undegraded":"2024-05-08T10:23:47.429673+0000","last_fullsized":"2024-05-08T10:23:47.429673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.438367+0000","last_change":"2024-05-08T10:23:47.435845+0000","last_active":"2024-05-08T10:23:47.438367+0000","last_peered":"2024-05-08T10:23:47.438367+0000","last_clean":"2024-05-08T10:23:47.438367+0000","last_became_active":"2024-05-08T10:23:47.435557+0000","last_became_peered":"2024-05-08T10:23:47.435557+0000","last_unstale":"2024-05-08T10:23:47.438367+0000","last_undegraded":"2024-05-08T10:23:47.438367+0000","last_fullsized":"2024-05-08T10:23:47.438367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-08T10:23:47.425885+0000","last_change":"2024-05-08T10:23:47.425885+0000","last_active":"2024-05-08T10:23:47.415124+0000","last_peered":"2024-05-08T10:23:47.415124+0000","last_clean":"2024-05-08T10:23:47.415124+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:23:47.425885+0000","last_undegraded":"2024-05-08T10:23:47.425885+0000","last_fullsized":"2024-05-08T10:23:47.425885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-08T10:23:47.443369+0000","last_change":"2024-05-08T10:23:47.439956+0000","last_active":"2024-05-08T10:23:47.443369+0000","last_peered":"2024-05-08T10:23:47.443369+0000","last_clean":"2024-05-08T10:23:47.443369+0000","last_became_active":"2024-05-08T10:23:47.439661+0000","last_became_peered":"2024-05-08T10:23:47.439661+0000","last_unstale":"2024-05-08T10:23:47.443369+0000","last_undegraded":"2024-05-08T10:23:47.443369+0000","last_fullsized":"2024-05-08T10:23:47.443369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:25.274204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":774144,"data_stored":648227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:23:55.839 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:23:55.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.964+0000 7f4a95c83640 1 Processor -- start 2024-05-08T10:23:55.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.965+0000 7f4a95c83640 1 -- start start 2024-05-08T10:23:55.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.965+0000 7f4a95c83640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a9015f760 0x7f4a900b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:55.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.965+0000 7f4a95c83640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4a900cfc10 0x7f4a900d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:55.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.965+0000 7f4a95c83640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4a900d0830 0x7f4a900b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:55.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.965+0000 7f4a95c83640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9015fb40 con 0x7f4a900d0830 2024-05-08T10:23:55.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.965+0000 7f4a95c83640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f4a900d0070 con 0x7f4a900cfc10 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.965+0000 7f4a95c83640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4a900d36f0 con 0x7f4a9015f760 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.965+0000 7f4a8ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4a900d0830 0x7f4a900b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4a900d0830 0x7f4a900b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35890/0 (socket says 172.21.15.143:35890) 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8ffff640 1 -- 172.21.15.143:0/3198772483 learned_addr learned my addr 172.21.15.143:0/3198772483 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8effd640 1 --2- 172.21.15.143:0/3198772483 >> v2:172.21.15.163:3300/0 conn(0x7f4a900cfc10 0x7f4a900d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8f7fe640 1 --2- 172.21.15.143:0/3198772483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a9015f760 0x7f4a900b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8ffff640 1 -- 172.21.15.143:0/3198772483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a9015f760 msgr2=0x7f4a900b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8ffff640 1 --2- 172.21.15.143:0/3198772483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a9015f760 0x7f4a900b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8ffff640 1 -- 172.21.15.143:0/3198772483 >> v2:172.21.15.163:3300/0 conn(0x7f4a900cfc10 msgr2=0x7f4a900d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8ffff640 1 --2- 172.21.15.143:0/3198772483 >> v2:172.21.15.163:3300/0 conn(0x7f4a900cfc10 0x7f4a900d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8ffff640 1 -- 172.21.15.143:0/3198772483 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a900d39d0 con 0x7f4a900d0830 2024-05-08T10:23:55.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.966+0000 7f4a8f7fe640 1 --2- 172.21.15.143:0/3198772483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a9015f760 0x7f4a900b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a8ffff640 1 --2- 172.21.15.143:0/3198772483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a900d0830 0x7f4a900b6d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a9006e380 tx=0x7f4a8802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392594f6c0183251 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a8e7fc640 1 -- 172.21.15.143:0/3198772483 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88037070 con 0x7f4a900d0830 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a8e7fc640 1 -- 172.21.15.143:0/3198772483 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a88032440 con 0x7f4a900d0830 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a8e7fc640 1 -- 172.21.15.143:0/3198772483 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88032810 con 0x7f4a900d0830 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a95c83640 1 -- 172.21.15.143:0/3198772483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a900d0830 msgr2=0x7f4a900b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a95c83640 1 --2- 172.21.15.143:0/3198772483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a900d0830 0x7f4a900b6d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a9006e380 tx=0x7f4a8802a140 comp rx=0 tx=0).stop 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a95c83640 1 -- 172.21.15.143:0/3198772483 shutdown_connections 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a95c83640 1 --2- 172.21.15.143:0/3198772483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a900d0830 0x7f4a900b6d10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a95c83640 1 --2- 172.21.15.143:0/3198772483 >> v2:172.21.15.163:3300/0 conn(0x7f4a900cfc10 0x7f4a900d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a95c83640 1 --2- 172.21.15.143:0/3198772483 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a9015f760 0x7f4a900b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a95c83640 1 -- 172.21.15.143:0/3198772483 >> 172.21.15.143:0/3198772483 conn(0x7f4a900740e0 msgr2=0x7f4a9006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a95c83640 1 -- 172.21.15.143:0/3198772483 shutdown_connections 2024-05-08T10:23:55.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.967+0000 7f4a95c83640 1 -- 172.21.15.143:0/3198772483 wait complete. 2024-05-08T10:23:55.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.969+0000 7f4a95c83640 1 Processor -- start 2024-05-08T10:23:55.955 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.969+0000 7f4a95c83640 1 -- start start 2024-05-08T10:23:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a95c83640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a900cfc10 0x7f4a90154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a95c83640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a900d0830 0x7f4a90161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a95c83640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a9015f760 0x7f4a901618c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a95c83640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4a900d4270 con 0x7f4a9015f760 2024-05-08T10:23:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a95c83640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4a900d3f90 con 0x7f4a900d0830 2024-05-08T10:23:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a95c83640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4a900d4790 con 0x7f4a900cfc10 2024-05-08T10:23:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a9015f760 0x7f4a901618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a9015f760 0x7f4a901618c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35894/0 (socket says 172.21.15.143:35894) 2024-05-08T10:23:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8ffff640 1 -- 172.21.15.143:0/2961391728 learned_addr learned my addr 172.21.15.143:0/2961391728 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8effd640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a900d0830 0x7f4a90161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8f7fe640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a900cfc10 0x7f4a90154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8ffff640 1 -- 172.21.15.143:0/2961391728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a900cfc10 msgr2=0x7f4a90154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8ffff640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a900cfc10 0x7f4a90154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8ffff640 1 -- 172.21.15.143:0/2961391728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a900d0830 msgr2=0x7f4a90161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8ffff640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a900d0830 0x7f4a90161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8ffff640 1 -- 172.21.15.143:0/2961391728 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a90162140 con 0x7f4a9015f760 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a8ffff640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a9015f760 0x7f4a901618c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4a880090b0 tx=0x7f4a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a77fff640 1 -- 172.21.15.143:0/2961391728 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88041070 con 0x7f4a9015f760 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a77fff640 1 -- 172.21.15.143:0/2961391728 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8803c870 con 0x7f4a9015f760 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a77fff640 1 -- 172.21.15.143:0/2961391728 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88037040 con 0x7f4a9015f760 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a90162420 con 0x7f4a9015f760 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.970+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a901629e0 con 0x7f4a9015f760 2024-05-08T10:23:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.971+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9006a550 con 0x7f4a9015f760 2024-05-08T10:23:55.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.972+0000 7f4a77fff640 1 -- 172.21.15.143:0/2961391728 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4a88044070 con 0x7f4a9015f760 2024-05-08T10:23:55.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.972+0000 7f4a77fff640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4a7c0762d0 0x7f4a7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:55.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.972+0000 7f4a8f7fe640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4a7c0762d0 0x7f4a7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:55.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.972+0000 7f4a77fff640 1 -- 172.21.15.143:0/2961391728 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4a880b7f40 con 0x7f4a9015f760 2024-05-08T10:23:55.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.973+0000 7f4a8f7fe640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4a7c0762d0 0x7f4a7c078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000d540 tx=0x7f4a80007810 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:55.977+0000 7f4a77fff640 1 -- 172.21.15.143:0/2961391728 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4a880812e0 con 0x7f4a9015f760 2024-05-08T10:23:56.134 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:23:56.136 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:23:56.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.155+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a9015cd70 con 0x7f4a7c0762d0 2024-05-08T10:23:56.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.161+0000 7f4a77fff640 1 -- 172.21.15.143:0/2961391728 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f4a9015cd70 con 0x7f4a7c0762d0 2024-05-08T10:23:56.148 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:56.150 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:23:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4a7c0762d0 msgr2=0x7f4a7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4a7c0762d0 0x7f4a7c078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000d540 tx=0x7f4a80007810 comp rx=0 tx=0).stop 2024-05-08T10:23:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a9015f760 msgr2=0x7f4a901618c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a9015f760 0x7f4a901618c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4a880090b0 tx=0x7f4a880046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 shutdown_connections 2024-05-08T10:23:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4a7c0762d0 0x7f4a7c078790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a9015f760 0x7f4a901618c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a900d0830 0x7f4a90161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 --2- 172.21.15.143:0/2961391728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4a900cfc10 0x7f4a90154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 >> 172.21.15.143:0/2961391728 conn(0x7f4a900740e0 msgr2=0x7f4a9006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:56.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 shutdown_connections 2024-05-08T10:23:56.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.164+0000 7f4a95c83640 1 -- 172.21.15.143:0/2961391728 wait complete. 2024-05-08T10:23:56.161 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-08T10:23:54.525559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.101626"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071730+0000","last_change":"2024-05-08T10:23:48.455169+0000","last_active":"2024-05-08T10:23:50.071730+0000","last_peered":"2024-05-08T10:23:50.071730+0000","last_clean":"2024-05-08T10:23:50.071730+0000","last_became_active":"2024-05-08T10:23:48.454403+0000","last_became_peered":"2024-05-08T10:23:48.454403+0000","last_unstale":"2024-05-08T10:23:50.071730+0000","last_undegraded":"2024-05-08T10:23:50.071730+0000","last_fullsized":"2024-05-08T10:23:50.071730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:56.686042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439355+0000","last_change":"2024-05-08T10:23:48.442523+0000","last_active":"2024-05-08T10:23:49.439355+0000","last_peered":"2024-05-08T10:23:49.439355+0000","last_clean":"2024-05-08T10:23:49.439355+0000","last_became_active":"2024-05-08T10:23:48.442211+0000","last_became_peered":"2024-05-08T10:23:48.442211+0000","last_unstale":"2024-05-08T10:23:49.439355+0000","last_undegraded":"2024-05-08T10:23:49.439355+0000","last_fullsized":"2024-05-08T10:23:49.439355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071683+0000","last_change":"2024-05-08T10:23:48.438711+0000","last_active":"2024-05-08T10:23:50.071683+0000","last_peered":"2024-05-08T10:23:50.071683+0000","last_clean":"2024-05-08T10:23:50.071683+0000","last_became_active":"2024-05-08T10:23:48.438466+0000","last_became_peered":"2024-05-08T10:23:48.438466+0000","last_unstale":"2024-05-08T10:23:50.071683+0000","last_undegraded":"2024-05-08T10:23:50.071683+0000","last_fullsized":"2024-05-08T10:23:50.071683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071038+0000","last_change":"2024-05-08T10:23:48.452779+0000","last_active":"2024-05-08T10:23:50.071038+0000","last_peered":"2024-05-08T10:23:50.071038+0000","last_clean":"2024-05-08T10:23:50.071038+0000","last_became_active":"2024-05-08T10:23:48.452512+0000","last_became_peered":"2024-05-08T10:23:48.452512+0000","last_unstale":"2024-05-08T10:23:50.071038+0000","last_undegraded":"2024-05-08T10:23:50.071038+0000","last_fullsized":"2024-05-08T10:23:50.071038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:53:25.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071595+0000","last_change":"2024-05-08T10:23:48.444482+0000","last_active":"2024-05-08T10:23:50.071595+0000","last_peered":"2024-05-08T10:23:50.071595+0000","last_clean":"2024-05-08T10:23:50.071595+0000","last_became_active":"2024-05-08T10:23:48.444220+0000","last_became_peered":"2024-05-08T10:23:48.444220+0000","last_unstale":"2024-05-08T10:23:50.071595+0000","last_undegraded":"2024-05-08T10:23:50.071595+0000","last_fullsized":"2024-05-08T10:23:50.071595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:16.618080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070751+0000","last_change":"2024-05-08T10:23:48.452552+0000","last_active":"2024-05-08T10:23:50.070751+0000","last_peered":"2024-05-08T10:23:50.070751+0000","last_clean":"2024-05-08T10:23:50.070751+0000","last_became_active":"2024-05-08T10:23:48.452278+0000","last_became_peered":"2024-05-08T10:23:48.452278+0000","last_unstale":"2024-05-08T10:23:50.070751+0000","last_undegraded":"2024-05-08T10:23:50.070751+0000","last_fullsized":"2024-05-08T10:23:50.070751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:19.879536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071656+0000","last_change":"2024-05-08T10:23:48.449071+0000","last_active":"2024-05-08T10:23:50.071656+0000","last_peered":"2024-05-08T10:23:50.071656+0000","last_clean":"2024-05-08T10:23:50.071656+0000","last_became_active":"2024-05-08T10:23:48.448781+0000","last_became_peered":"2024-05-08T10:23:48.448781+0000","last_unstale":"2024-05-08T10:23:50.071656+0000","last_undegraded":"2024-05-08T10:23:50.071656+0000","last_fullsized":"2024-05-08T10:23:50.071656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:03.419955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070796+0000","last_change":"2024-05-08T10:23:48.450877+0000","last_active":"2024-05-08T10:23:50.070796+0000","last_peered":"2024-05-08T10:23:50.070796+0000","last_clean":"2024-05-08T10:23:50.070796+0000","last_became_active":"2024-05-08T10:23:48.450628+0000","last_became_peered":"2024-05-08T10:23:48.450628+0000","last_unstale":"2024-05-08T10:23:50.070796+0000","last_undegraded":"2024-05-08T10:23:50.070796+0000","last_fullsized":"2024-05-08T10:23:50.070796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071902+0000","last_change":"2024-05-08T10:23:48.455413+0000","last_active":"2024-05-08T10:23:50.071902+0000","last_peered":"2024-05-08T10:23:50.071902+0000","last_clean":"2024-05-08T10:23:50.071902+0000","last_became_active":"2024-05-08T10:23:48.454809+0000","last_became_peered":"2024-05-08T10:23:48.454809+0000","last_unstale":"2024-05-08T10:23:50.071902+0000","last_undegraded":"2024-05-08T10:23:50.071902+0000","last_fullsized":"2024-05-08T10:23:50.071902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:52.424060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070075+0000","last_change":"2024-05-08T10:23:48.452786+0000","last_active":"2024-05-08T10:23:50.070075+0000","last_peered":"2024-05-08T10:23:50.070075+0000","last_clean":"2024-05-08T10:23:50.070075+0000","last_became_active":"2024-05-08T10:23:48.452530+0000","last_became_peered":"2024-05-08T10:23:48.452530+0000","last_unstale":"2024-05-08T10:23:50.070075+0000","last_undegraded":"2024-05-08T10:23:50.070075+0000","last_fullsized":"2024-05-08T10:23:50.070075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069864+0000","last_change":"2024-05-08T10:23:48.452235+0000","last_active":"2024-05-08T10:23:50.069864+0000","last_peered":"2024-05-08T10:23:50.069864+0000","last_clean":"2024-05-08T10:23:50.069864+0000","last_became_active":"2024-05-08T10:23:48.451251+0000","last_became_peered":"2024-05-08T10:23:48.451251+0000","last_unstale":"2024-05-08T10:23:50.069864+0000","last_undegraded":"2024-05-08T10:23:50.069864+0000","last_fullsized":"2024-05-08T10:23:50.069864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440335+0000","last_change":"2024-05-08T10:23:48.445982+0000","last_active":"2024-05-08T10:23:49.440335+0000","last_peered":"2024-05-08T10:23:49.440335+0000","last_clean":"2024-05-08T10:23:49.440335+0000","last_became_active":"2024-05-08T10:23:48.445309+0000","last_became_peered":"2024-05-08T10:23:48.445309+0000","last_unstale":"2024-05-08T10:23:49.440335+0000","last_undegraded":"2024-05-08T10:23:49.440335+0000","last_fullsized":"2024-05-08T10:23:49.440335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:35.017589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071368+0000","last_change":"2024-05-08T10:23:48.446813+0000","last_active":"2024-05-08T10:23:50.071368+0000","last_peered":"2024-05-08T10:23:50.071368+0000","last_clean":"2024-05-08T10:23:50.071368+0000","last_became_active":"2024-05-08T10:23:48.446447+0000","last_became_peered":"2024-05-08T10:23:48.446447+0000","last_unstale":"2024-05-08T10:23:50.071368+0000","last_undegraded":"2024-05-08T10:23:50.071368+0000","last_fullsized":"2024-05-08T10:23:50.071368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:56.686042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071183+0000","last_change":"2024-05-08T10:23:48.449737+0000","last_active":"2024-05-08T10:23:50.071183+0000","last_peered":"2024-05-08T10:23:50.071183+0000","last_clean":"2024-05-08T10:23:50.071183+0000","last_became_active":"2024-05-08T10:23:48.449477+0000","last_became_peered":"2024-05-08T10:23:48.449477+0000","last_unstale":"2024-05-08T10:23:50.071183+0000","last_undegraded":"2024-05-08T10:23:50.071183+0000","last_fullsized":"2024-05-08T10:23:50.071183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:00.805521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439204+0000","last_change":"2024-05-08T10:23:48.441880+0000","last_active":"2024-05-08T10:23:49.439204+0000","last_peered":"2024-05-08T10:23:49.439204+0000","last_clean":"2024-05-08T10:23:49.439204+0000","last_became_active":"2024-05-08T10:23:48.441190+0000","last_became_peered":"2024-05-08T10:23:48.441190+0000","last_unstale":"2024-05-08T10:23:49.439204+0000","last_undegraded":"2024-05-08T10:23:49.439204+0000","last_fullsized":"2024-05-08T10:23:49.439204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070683+0000","last_change":"2024-05-08T10:23:48.451077+0000","last_active":"2024-05-08T10:23:50.070683+0000","last_peered":"2024-05-08T10:23:50.070683+0000","last_clean":"2024-05-08T10:23:50.070683+0000","last_became_active":"2024-05-08T10:23:48.450806+0000","last_became_peered":"2024-05-08T10:23:48.450806+0000","last_unstale":"2024-05-08T10:23:50.070683+0000","last_undegraded":"2024-05-08T10:23:50.070683+0000","last_fullsized":"2024-05-08T10:23:50.070683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071684+0000","last_change":"2024-05-08T10:23:48.456531+0000","last_active":"2024-05-08T10:23:50.071684+0000","last_peered":"2024-05-08T10:23:50.071684+0000","last_clean":"2024-05-08T10:23:50.071684+0000","last_became_active":"2024-05-08T10:23:48.456284+0000","last_became_peered":"2024-05-08T10:23:48.456284+0000","last_unstale":"2024-05-08T10:23:50.071684+0000","last_undegraded":"2024-05-08T10:23:50.071684+0000","last_fullsized":"2024-05-08T10:23:50.071684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:03.419955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439889+0000","last_change":"2024-05-08T10:23:48.442085+0000","last_active":"2024-05-08T10:23:49.439889+0000","last_peered":"2024-05-08T10:23:49.439889+0000","last_clean":"2024-05-08T10:23:49.439889+0000","last_became_active":"2024-05-08T10:23:48.441801+0000","last_became_peered":"2024-05-08T10:23:48.441801+0000","last_unstale":"2024-05-08T10:23:49.439889+0000","last_undegraded":"2024-05-08T10:23:49.439889+0000","last_fullsized":"2024-05-08T10:23:49.439889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:31.689147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072156+0000","last_change":"2024-05-08T10:23:48.446130+0000","last_active":"2024-05-08T10:23:50.072156+0000","last_peered":"2024-05-08T10:23:50.072156+0000","last_clean":"2024-05-08T10:23:50.072156+0000","last_became_active":"2024-05-08T10:23:48.445847+0000","last_became_peered":"2024-05-08T10:23:48.445847+0000","last_unstale":"2024-05-08T10:23:50.072156+0000","last_undegraded":"2024-05-08T10:23:50.072156+0000","last_fullsized":"2024-05-08T10:23:50.072156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:21.241922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069885+0000","last_change":"2024-05-08T10:23:48.444206+0000","last_active":"2024-05-08T10:23:50.069885+0000","last_peered":"2024-05-08T10:23:50.069885+0000","last_clean":"2024-05-08T10:23:50.069885+0000","last_became_active":"2024-05-08T10:23:48.443938+0000","last_became_peered":"2024-05-08T10:23:48.443938+0000","last_unstale":"2024-05-08T10:23:50.069885+0000","last_undegraded":"2024-05-08T10:23:50.069885+0000","last_fullsized":"2024-05-08T10:23:50.069885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071229+0000","last_change":"2024-05-08T10:23:48.455150+0000","last_active":"2024-05-08T10:23:50.071229+0000","last_peered":"2024-05-08T10:23:50.071229+0000","last_clean":"2024-05-08T10:23:50.071229+0000","last_became_active":"2024-05-08T10:23:48.454911+0000","last_became_peered":"2024-05-08T10:23:48.454911+0000","last_unstale":"2024-05-08T10:23:50.071229+0000","last_undegraded":"2024-05-08T10:23:50.071229+0000","last_fullsized":"2024-05-08T10:23:50.071229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:50:17.413158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070974+0000","last_change":"2024-05-08T10:23:48.455822+0000","last_active":"2024-05-08T10:23:50.070974+0000","last_peered":"2024-05-08T10:23:50.070974+0000","last_clean":"2024-05-08T10:23:50.070974+0000","last_became_active":"2024-05-08T10:23:48.455339+0000","last_became_peered":"2024-05-08T10:23:48.455339+0000","last_unstale":"2024-05-08T10:23:50.070974+0000","last_undegraded":"2024-05-08T10:23:50.070974+0000","last_fullsized":"2024-05-08T10:23:50.070974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:17.618922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070826+0000","last_change":"2024-05-08T10:23:48.436289+0000","last_active":"2024-05-08T10:23:50.070826+0000","last_peered":"2024-05-08T10:23:50.070826+0000","last_clean":"2024-05-08T10:23:50.070826+0000","last_became_active":"2024-05-08T10:23:48.436039+0000","last_became_peered":"2024-05-08T10:23:48.436039+0000","last_unstale":"2024-05-08T10:23:50.070826+0000","last_undegraded":"2024-05-08T10:23:50.070826+0000","last_fullsized":"2024-05-08T10:23:50.070826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071248+0000","last_change":"2024-05-08T10:23:48.450416+0000","last_active":"2024-05-08T10:23:50.071248+0000","last_peered":"2024-05-08T10:23:50.071248+0000","last_clean":"2024-05-08T10:23:50.071248+0000","last_became_active":"2024-05-08T10:23:48.450131+0000","last_became_peered":"2024-05-08T10:23:48.450131+0000","last_unstale":"2024-05-08T10:23:50.071248+0000","last_undegraded":"2024-05-08T10:23:50.071248+0000","last_fullsized":"2024-05-08T10:23:50.071248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:44:13.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071001+0000","last_change":"2024-05-08T10:23:48.437015+0000","last_active":"2024-05-08T10:23:50.071001+0000","last_peered":"2024-05-08T10:23:50.071001+0000","last_clean":"2024-05-08T10:23:50.071001+0000","last_became_active":"2024-05-08T10:23:48.436779+0000","last_became_peered":"2024-05-08T10:23:48.436779+0000","last_unstale":"2024-05-08T10:23:50.071001+0000","last_undegraded":"2024-05-08T10:23:50.071001+0000","last_fullsized":"2024-05-08T10:23:50.071001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070202+0000","last_change":"2024-05-08T10:23:48.443798+0000","last_active":"2024-05-08T10:23:50.070202+0000","last_peered":"2024-05-08T10:23:50.070202+0000","last_clean":"2024-05-08T10:23:50.070202+0000","last_became_active":"2024-05-08T10:23:48.442703+0000","last_became_peered":"2024-05-08T10:23:48.442703+0000","last_unstale":"2024-05-08T10:23:50.070202+0000","last_undegraded":"2024-05-08T10:23:50.070202+0000","last_fullsized":"2024-05-08T10:23:50.070202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:19.879536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439323+0000","last_change":"2024-05-08T10:23:48.448757+0000","last_active":"2024-05-08T10:23:49.439323+0000","last_peered":"2024-05-08T10:23:49.439323+0000","last_clean":"2024-05-08T10:23:49.439323+0000","last_became_active":"2024-05-08T10:23:48.445205+0000","last_became_peered":"2024-05-08T10:23:48.445205+0000","last_unstale":"2024-05-08T10:23:49.439323+0000","last_undegraded":"2024-05-08T10:23:49.439323+0000","last_fullsized":"2024-05-08T10:23:49.439323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071548+0000","last_change":"2024-05-08T10:23:48.436978+0000","last_active":"2024-05-08T10:23:50.071548+0000","last_peered":"2024-05-08T10:23:50.071548+0000","last_clean":"2024-05-08T10:23:50.071548+0000","last_became_active":"2024-05-08T10:23:48.436738+0000","last_became_peered":"2024-05-08T10:23:48.436738+0000","last_unstale":"2024-05-08T10:23:50.071548+0000","last_undegraded":"2024-05-08T10:23:50.071548+0000","last_fullsized":"2024-05-08T10:23:50.071548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:44:13.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071465+0000","last_change":"2024-05-08T10:23:48.443335+0000","last_active":"2024-05-08T10:23:50.071465+0000","last_peered":"2024-05-08T10:23:50.071465+0000","last_clean":"2024-05-08T10:23:50.071465+0000","last_became_active":"2024-05-08T10:23:48.443060+0000","last_became_peered":"2024-05-08T10:23:48.443060+0000","last_unstale":"2024-05-08T10:23:50.071465+0000","last_undegraded":"2024-05-08T10:23:50.071465+0000","last_fullsized":"2024-05-08T10:23:50.071465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071030+0000","last_change":"2024-05-08T10:23:48.450521+0000","last_active":"2024-05-08T10:23:50.071030+0000","last_peered":"2024-05-08T10:23:50.071030+0000","last_clean":"2024-05-08T10:23:50.071030+0000","last_became_active":"2024-05-08T10:23:48.450218+0000","last_became_peered":"2024-05-08T10:23:48.450218+0000","last_unstale":"2024-05-08T10:23:50.071030+0000","last_undegraded":"2024-05-08T10:23:50.071030+0000","last_fullsized":"2024-05-08T10:23:50.071030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:56.686042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439839+0000","last_change":"2024-05-08T10:23:48.451961+0000","last_active":"2024-05-08T10:23:49.439839+0000","last_peered":"2024-05-08T10:23:49.439839+0000","last_clean":"2024-05-08T10:23:49.439839+0000","last_became_active":"2024-05-08T10:23:48.451678+0000","last_became_peered":"2024-05-08T10:23:48.451678+0000","last_unstale":"2024-05-08T10:23:49.439839+0000","last_undegraded":"2024-05-08T10:23:49.439839+0000","last_fullsized":"2024-05-08T10:23:49.439839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:09.213193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069663+0000","last_change":"2024-05-08T10:23:48.443980+0000","last_active":"2024-05-08T10:23:50.069663+0000","last_peered":"2024-05-08T10:23:50.069663+0000","last_clean":"2024-05-08T10:23:50.069663+0000","last_became_active":"2024-05-08T10:23:48.443469+0000","last_became_peered":"2024-05-08T10:23:48.443469+0000","last_unstale":"2024-05-08T10:23:50.069663+0000","last_undegraded":"2024-05-08T10:23:50.069663+0000","last_fullsized":"2024-05-08T10:23:50.069663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440644+0000","last_change":"2024-05-08T10:23:48.442083+0000","last_active":"2024-05-08T10:23:49.440644+0000","last_peered":"2024-05-08T10:23:49.440644+0000","last_clean":"2024-05-08T10:23:49.440644+0000","last_became_active":"2024-05-08T10:23:48.441800+0000","last_became_peered":"2024-05-08T10:23:48.441800+0000","last_unstale":"2024-05-08T10:23:49.440644+0000","last_undegraded":"2024-05-08T10:23:49.440644+0000","last_fullsized":"2024-05-08T10:23:49.440644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:09.213193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071590+0000","last_change":"2024-05-08T10:23:47.440565+0000","last_active":"2024-05-08T10:23:50.071590+0000","last_peered":"2024-05-08T10:23:50.071590+0000","last_clean":"2024-05-08T10:23:50.071590+0000","last_became_active":"2024-05-08T10:23:47.440296+0000","last_became_peered":"2024-05-08T10:23:47.440296+0000","last_unstale":"2024-05-08T10:23:50.071590+0000","last_undegraded":"2024-05-08T10:23:50.071590+0000","last_fullsized":"2024-05-08T10:23:50.071590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071386+0000","last_change":"2024-05-08T10:23:48.448280+0000","last_active":"2024-05-08T10:23:50.071386+0000","last_peered":"2024-05-08T10:23:50.071386+0000","last_clean":"2024-05-08T10:23:50.071386+0000","last_became_active":"2024-05-08T10:23:48.446906+0000","last_became_peered":"2024-05-08T10:23:48.446906+0000","last_unstale":"2024-05-08T10:23:50.071386+0000","last_undegraded":"2024-05-08T10:23:50.071386+0000","last_fullsized":"2024-05-08T10:23:50.071386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:45.698206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069700+0000","last_change":"2024-05-08T10:23:47.432111+0000","last_active":"2024-05-08T10:23:50.069700+0000","last_peered":"2024-05-08T10:23:50.069700+0000","last_clean":"2024-05-08T10:23:50.069700+0000","last_became_active":"2024-05-08T10:23:47.430756+0000","last_became_peered":"2024-05-08T10:23:47.430756+0000","last_unstale":"2024-05-08T10:23:50.069700+0000","last_undegraded":"2024-05-08T10:23:50.069700+0000","last_fullsized":"2024-05-08T10:23:50.069700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070922+0000","last_change":"2024-05-08T10:23:47.431893+0000","last_active":"2024-05-08T10:23:50.070922+0000","last_peered":"2024-05-08T10:23:50.070922+0000","last_clean":"2024-05-08T10:23:50.070922+0000","last_became_active":"2024-05-08T10:23:47.431613+0000","last_became_peered":"2024-05-08T10:23:47.431613+0000","last_unstale":"2024-05-08T10:23:50.070922+0000","last_undegraded":"2024-05-08T10:23:50.070922+0000","last_fullsized":"2024-05-08T10:23:50.070922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070872+0000","last_change":"2024-05-08T10:23:48.440041+0000","last_active":"2024-05-08T10:23:50.070872+0000","last_peered":"2024-05-08T10:23:50.070872+0000","last_clean":"2024-05-08T10:23:50.070872+0000","last_became_active":"2024-05-08T10:23:48.439778+0000","last_became_peered":"2024-05-08T10:23:48.439778+0000","last_unstale":"2024-05-08T10:23:50.070872+0000","last_undegraded":"2024-05-08T10:23:50.070872+0000","last_fullsized":"2024-05-08T10:23:50.070872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070865+0000","last_change":"2024-05-08T10:23:47.436762+0000","last_active":"2024-05-08T10:23:50.070865+0000","last_peered":"2024-05-08T10:23:50.070865+0000","last_clean":"2024-05-08T10:23:50.070865+0000","last_became_active":"2024-05-08T10:23:47.436442+0000","last_became_peered":"2024-05-08T10:23:47.436442+0000","last_unstale":"2024-05-08T10:23:50.070865+0000","last_undegraded":"2024-05-08T10:23:50.070865+0000","last_fullsized":"2024-05-08T10:23:50.070865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439049+0000","last_change":"2024-05-08T10:23:48.442152+0000","last_active":"2024-05-08T10:23:49.439049+0000","last_peered":"2024-05-08T10:23:49.439049+0000","last_clean":"2024-05-08T10:23:49.439049+0000","last_became_active":"2024-05-08T10:23:48.441502+0000","last_became_peered":"2024-05-08T10:23:48.441502+0000","last_unstale":"2024-05-08T10:23:49.439049+0000","last_undegraded":"2024-05-08T10:23:49.439049+0000","last_fullsized":"2024-05-08T10:23:49.439049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069890+0000","last_change":"2024-05-08T10:23:47.439183+0000","last_active":"2024-05-08T10:23:50.069890+0000","last_peered":"2024-05-08T10:23:50.069890+0000","last_clean":"2024-05-08T10:23:50.069890+0000","last_became_active":"2024-05-08T10:23:47.438842+0000","last_became_peered":"2024-05-08T10:23:47.438842+0000","last_unstale":"2024-05-08T10:23:50.069890+0000","last_undegraded":"2024-05-08T10:23:50.069890+0000","last_fullsized":"2024-05-08T10:23:50.069890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071287+0000","last_change":"2024-05-08T10:23:48.455537+0000","last_active":"2024-05-08T10:23:50.071287+0000","last_peered":"2024-05-08T10:23:50.071287+0000","last_clean":"2024-05-08T10:23:50.071287+0000","last_became_active":"2024-05-08T10:23:48.455276+0000","last_became_peered":"2024-05-08T10:23:48.455276+0000","last_unstale":"2024-05-08T10:23:50.071287+0000","last_undegraded":"2024-05-08T10:23:50.071287+0000","last_fullsized":"2024-05-08T10:23:50.071287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:31.821509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071153+0000","last_change":"2024-05-08T10:23:47.442360+0000","last_active":"2024-05-08T10:23:50.071153+0000","last_peered":"2024-05-08T10:23:50.071153+0000","last_clean":"2024-05-08T10:23:50.071153+0000","last_became_active":"2024-05-08T10:23:47.442107+0000","last_became_peered":"2024-05-08T10:23:47.442107+0000","last_unstale":"2024-05-08T10:23:50.071153+0000","last_undegraded":"2024-05-08T10:23:50.071153+0000","last_fullsized":"2024-05-08T10:23:50.071153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071781+0000","last_change":"2024-05-08T10:23:48.451904+0000","last_active":"2024-05-08T10:23:50.071781+0000","last_peered":"2024-05-08T10:23:50.071781+0000","last_clean":"2024-05-08T10:23:50.071781+0000","last_became_active":"2024-05-08T10:23:48.451622+0000","last_became_peered":"2024-05-08T10:23:48.451622+0000","last_unstale":"2024-05-08T10:23:50.071781+0000","last_undegraded":"2024-05-08T10:23:50.071781+0000","last_fullsized":"2024-05-08T10:23:50.071781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439437+0000","last_change":"2024-05-08T10:23:47.438561+0000","last_active":"2024-05-08T10:23:49.439437+0000","last_peered":"2024-05-08T10:23:49.439437+0000","last_clean":"2024-05-08T10:23:49.439437+0000","last_became_active":"2024-05-08T10:23:47.437710+0000","last_became_peered":"2024-05-08T10:23:47.437710+0000","last_unstale":"2024-05-08T10:23:49.439437+0000","last_undegraded":"2024-05-08T10:23:49.439437+0000","last_fullsized":"2024-05-08T10:23:49.439437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440449+0000","last_change":"2024-05-08T10:23:48.442317+0000","last_active":"2024-05-08T10:23:49.440449+0000","last_peered":"2024-05-08T10:23:49.440449+0000","last_clean":"2024-05-08T10:23:49.440449+0000","last_became_active":"2024-05-08T10:23:48.440195+0000","last_became_peered":"2024-05-08T10:23:48.440195+0000","last_unstale":"2024-05-08T10:23:49.440449+0000","last_undegraded":"2024-05-08T10:23:49.440449+0000","last_fullsized":"2024-05-08T10:23:49.440449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:04.879915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069882+0000","last_change":"2024-05-08T10:23:47.436584+0000","last_active":"2024-05-08T10:23:50.069882+0000","last_peered":"2024-05-08T10:23:50.069882+0000","last_clean":"2024-05-08T10:23:50.069882+0000","last_became_active":"2024-05-08T10:23:47.436126+0000","last_became_peered":"2024-05-08T10:23:47.436126+0000","last_unstale":"2024-05-08T10:23:50.069882+0000","last_undegraded":"2024-05-08T10:23:50.069882+0000","last_fullsized":"2024-05-08T10:23:50.069882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071655+0000","last_change":"2024-05-08T10:23:48.448534+0000","last_active":"2024-05-08T10:23:50.071655+0000","last_peered":"2024-05-08T10:23:50.071655+0000","last_clean":"2024-05-08T10:23:50.071655+0000","last_became_active":"2024-05-08T10:23:48.448301+0000","last_became_peered":"2024-05-08T10:23:48.448301+0000","last_unstale":"2024-05-08T10:23:50.071655+0000","last_undegraded":"2024-05-08T10:23:50.071655+0000","last_fullsized":"2024-05-08T10:23:50.071655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:17.618922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071724+0000","last_change":"2024-05-08T10:23:47.435055+0000","last_active":"2024-05-08T10:23:50.071724+0000","last_peered":"2024-05-08T10:23:50.071724+0000","last_clean":"2024-05-08T10:23:50.071724+0000","last_became_active":"2024-05-08T10:23:47.434642+0000","last_became_peered":"2024-05-08T10:23:47.434642+0000","last_unstale":"2024-05-08T10:23:50.071724+0000","last_undegraded":"2024-05-08T10:23:50.071724+0000","last_fullsized":"2024-05-08T10:23:50.071724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071520+0000","last_change":"2024-05-08T10:23:48.443473+0000","last_active":"2024-05-08T10:23:50.071520+0000","last_peered":"2024-05-08T10:23:50.071520+0000","last_clean":"2024-05-08T10:23:50.071520+0000","last_became_active":"2024-05-08T10:23:48.443180+0000","last_became_peered":"2024-05-08T10:23:48.443180+0000","last_unstale":"2024-05-08T10:23:50.071520+0000","last_undegraded":"2024-05-08T10:23:50.071520+0000","last_fullsized":"2024-05-08T10:23:50.071520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071108+0000","last_change":"2024-05-08T10:23:47.437417+0000","last_active":"2024-05-08T10:23:50.071108+0000","last_peered":"2024-05-08T10:23:50.071108+0000","last_clean":"2024-05-08T10:23:50.071108+0000","last_became_active":"2024-05-08T10:23:47.437129+0000","last_became_peered":"2024-05-08T10:23:47.437129+0000","last_unstale":"2024-05-08T10:23:50.071108+0000","last_undegraded":"2024-05-08T10:23:50.071108+0000","last_fullsized":"2024-05-08T10:23:50.071108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071661+0000","last_change":"2024-05-08T10:23:48.441913+0000","last_active":"2024-05-08T10:23:50.071661+0000","last_peered":"2024-05-08T10:23:50.071661+0000","last_clean":"2024-05-08T10:23:50.071661+0000","last_became_active":"2024-05-08T10:23:48.439621+0000","last_became_peered":"2024-05-08T10:23:48.439621+0000","last_unstale":"2024-05-08T10:23:50.071661+0000","last_undegraded":"2024-05-08T10:23:50.071661+0000","last_fullsized":"2024-05-08T10:23:50.071661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:44:13.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069650+0000","last_change":"2024-05-08T10:23:47.432460+0000","last_active":"2024-05-08T10:23:50.069650+0000","last_peered":"2024-05-08T10:23:50.069650+0000","last_clean":"2024-05-08T10:23:50.069650+0000","last_became_active":"2024-05-08T10:23:47.432156+0000","last_became_peered":"2024-05-08T10:23:47.432156+0000","last_unstale":"2024-05-08T10:23:50.069650+0000","last_undegraded":"2024-05-08T10:23:50.069650+0000","last_fullsized":"2024-05-08T10:23:50.069650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069545+0000","last_change":"2024-05-08T10:23:48.443752+0000","last_active":"2024-05-08T10:23:50.069545+0000","last_peered":"2024-05-08T10:23:50.069545+0000","last_clean":"2024-05-08T10:23:50.069545+0000","last_became_active":"2024-05-08T10:23:48.443133+0000","last_became_peered":"2024-05-08T10:23:48.443133+0000","last_unstale":"2024-05-08T10:23:50.069545+0000","last_undegraded":"2024-05-08T10:23:50.069545+0000","last_fullsized":"2024-05-08T10:23:50.069545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439625+0000","last_change":"2024-05-08T10:23:47.439271+0000","last_active":"2024-05-08T10:23:49.439625+0000","last_peered":"2024-05-08T10:23:49.439625+0000","last_clean":"2024-05-08T10:23:49.439625+0000","last_became_active":"2024-05-08T10:23:47.438952+0000","last_became_peered":"2024-05-08T10:23:47.438952+0000","last_unstale":"2024-05-08T10:23:49.439625+0000","last_undegraded":"2024-05-08T10:23:49.439625+0000","last_fullsized":"2024-05-08T10:23:49.439625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071730+0000","last_change":"2024-05-08T10:23:48.450406+0000","last_active":"2024-05-08T10:23:50.071730+0000","last_peered":"2024-05-08T10:23:50.071730+0000","last_clean":"2024-05-08T10:23:50.071730+0000","last_became_active":"2024-05-08T10:23:48.450137+0000","last_became_peered":"2024-05-08T10:23:48.450137+0000","last_unstale":"2024-05-08T10:23:50.071730+0000","last_undegraded":"2024-05-08T10:23:50.071730+0000","last_fullsized":"2024-05-08T10:23:50.071730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:53:25.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440561+0000","last_change":"2024-05-08T10:23:47.436054+0000","last_active":"2024-05-08T10:23:49.440561+0000","last_peered":"2024-05-08T10:23:49.440561+0000","last_clean":"2024-05-08T10:23:49.440561+0000","last_became_active":"2024-05-08T10:23:47.435777+0000","last_became_peered":"2024-05-08T10:23:47.435777+0000","last_unstale":"2024-05-08T10:23:49.440561+0000","last_undegraded":"2024-05-08T10:23:49.440561+0000","last_fullsized":"2024-05-08T10:23:49.440561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071790+0000","last_change":"2024-05-08T10:23:48.439230+0000","last_active":"2024-05-08T10:23:50.071790+0000","last_peered":"2024-05-08T10:23:50.071790+0000","last_clean":"2024-05-08T10:23:50.071790+0000","last_became_active":"2024-05-08T10:23:48.438944+0000","last_became_peered":"2024-05-08T10:23:48.438944+0000","last_unstale":"2024-05-08T10:23:50.071790+0000","last_undegraded":"2024-05-08T10:23:50.071790+0000","last_fullsized":"2024-05-08T10:23:50.071790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.646809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439834+0000","last_change":"2024-05-08T10:23:47.428146+0000","last_active":"2024-05-08T10:23:49.439834+0000","last_peered":"2024-05-08T10:23:49.439834+0000","last_clean":"2024-05-08T10:23:49.439834+0000","last_became_active":"2024-05-08T10:23:47.427826+0000","last_became_peered":"2024-05-08T10:23:47.427826+0000","last_unstale":"2024-05-08T10:23:49.439834+0000","last_undegraded":"2024-05-08T10:23:49.439834+0000","last_fullsized":"2024-05-08T10:23:49.439834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072114+0000","last_change":"2024-05-08T10:23:48.456216+0000","last_active":"2024-05-08T10:23:50.072114+0000","last_peered":"2024-05-08T10:23:50.072114+0000","last_clean":"2024-05-08T10:23:50.072114+0000","last_became_active":"2024-05-08T10:23:48.455943+0000","last_became_peered":"2024-05-08T10:23:48.455943+0000","last_unstale":"2024-05-08T10:23:50.072114+0000","last_undegraded":"2024-05-08T10:23:50.072114+0000","last_fullsized":"2024-05-08T10:23:50.072114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:58.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439419+0000","last_change":"2024-05-08T10:23:47.438474+0000","last_active":"2024-05-08T10:23:49.439419+0000","last_peered":"2024-05-08T10:23:49.439419+0000","last_clean":"2024-05-08T10:23:49.439419+0000","last_became_active":"2024-05-08T10:23:47.437999+0000","last_became_peered":"2024-05-08T10:23:47.437999+0000","last_unstale":"2024-05-08T10:23:49.439419+0000","last_undegraded":"2024-05-08T10:23:49.439419+0000","last_fullsized":"2024-05-08T10:23:49.439419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:03.877856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071428+0000","last_change":"2024-05-08T10:23:48.452268+0000","last_active":"2024-05-08T10:23:50.071428+0000","last_peered":"2024-05-08T10:23:50.071428+0000","last_clean":"2024-05-08T10:23:50.071428+0000","last_became_active":"2024-05-08T10:23:48.451967+0000","last_became_peered":"2024-05-08T10:23:48.451967+0000","last_unstale":"2024-05-08T10:23:50.071428+0000","last_undegraded":"2024-05-08T10:23:50.071428+0000","last_fullsized":"2024-05-08T10:23:50.071428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:52.424060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439314+0000","last_change":"2024-05-08T10:23:47.437314+0000","last_active":"2024-05-08T10:23:49.439314+0000","last_peered":"2024-05-08T10:23:49.439314+0000","last_clean":"2024-05-08T10:23:49.439314+0000","last_became_active":"2024-05-08T10:23:47.436966+0000","last_became_peered":"2024-05-08T10:23:47.436966+0000","last_unstale":"2024-05-08T10:23:49.439314+0000","last_undegraded":"2024-05-08T10:23:49.439314+0000","last_fullsized":"2024-05-08T10:23:49.439314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071837+0000","last_change":"2024-05-08T10:23:48.452071+0000","last_active":"2024-05-08T10:23:50.071837+0000","last_peered":"2024-05-08T10:23:50.071837+0000","last_clean":"2024-05-08T10:23:50.071837+0000","last_became_active":"2024-05-08T10:23:48.451744+0000","last_became_peered":"2024-05-08T10:23:48.451744+0000","last_unstale":"2024-05-08T10:23:50.071837+0000","last_undegraded":"2024-05-08T10:23:50.071837+0000","last_fullsized":"2024-05-08T10:23:50.071837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:31.821509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071896+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:23:50.071896+0000","last_peered":"2024-05-08T10:23:50.071896+0000","last_clean":"2024-05-08T10:23:50.071896+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:23:50.071896+0000","last_undegraded":"2024-05-08T10:23:50.071896+0000","last_fullsized":"2024-05-08T10:23:50.071896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070816+0000","last_change":"2024-05-08T10:23:47.437924+0000","last_active":"2024-05-08T10:23:50.070816+0000","last_peered":"2024-05-08T10:23:50.070816+0000","last_clean":"2024-05-08T10:23:50.070816+0000","last_became_active":"2024-05-08T10:23:47.437630+0000","last_became_peered":"2024-05-08T10:23:47.437630+0000","last_unstale":"2024-05-08T10:23:50.070816+0000","last_undegraded":"2024-05-08T10:23:50.070816+0000","last_fullsized":"2024-05-08T10:23:50.070816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071143+0000","last_change":"2024-05-08T10:23:48.454035+0000","last_active":"2024-05-08T10:23:50.071143+0000","last_peered":"2024-05-08T10:23:50.071143+0000","last_clean":"2024-05-08T10:23:50.071143+0000","last_became_active":"2024-05-08T10:23:48.453770+0000","last_became_peered":"2024-05-08T10:23:48.453770+0000","last_unstale":"2024-05-08T10:23:50.071143+0000","last_undegraded":"2024-05-08T10:23:50.071143+0000","last_fullsized":"2024-05-08T10:23:50.071143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:19.879536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071396+0000","last_change":"2024-05-08T10:23:47.442183+0000","last_active":"2024-05-08T10:23:50.071396+0000","last_peered":"2024-05-08T10:23:50.071396+0000","last_clean":"2024-05-08T10:23:50.071396+0000","last_became_active":"2024-05-08T10:23:47.441485+0000","last_became_peered":"2024-05-08T10:23:47.441485+0000","last_unstale":"2024-05-08T10:23:50.071396+0000","last_undegraded":"2024-05-08T10:23:50.071396+0000","last_fullsized":"2024-05-08T10:23:50.071396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071720+0000","last_change":"2024-05-08T10:23:48.436512+0000","last_active":"2024-05-08T10:23:50.071720+0000","last_peered":"2024-05-08T10:23:50.071720+0000","last_clean":"2024-05-08T10:23:50.071720+0000","last_became_active":"2024-05-08T10:23:48.436244+0000","last_became_peered":"2024-05-08T10:23:48.436244+0000","last_unstale":"2024-05-08T10:23:50.071720+0000","last_undegraded":"2024-05-08T10:23:50.071720+0000","last_fullsized":"2024-05-08T10:23:50.071720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439825+0000","last_change":"2024-05-08T10:23:47.426677+0000","last_active":"2024-05-08T10:23:49.439825+0000","last_peered":"2024-05-08T10:23:49.439825+0000","last_clean":"2024-05-08T10:23:49.439825+0000","last_became_active":"2024-05-08T10:23:47.426406+0000","last_became_peered":"2024-05-08T10:23:47.426406+0000","last_unstale":"2024-05-08T10:23:49.439825+0000","last_undegraded":"2024-05-08T10:23:49.439825+0000","last_fullsized":"2024-05-08T10:23:49.439825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439093+0000","last_change":"2024-05-08T10:23:48.442557+0000","last_active":"2024-05-08T10:23:49.439093+0000","last_peered":"2024-05-08T10:23:49.439093+0000","last_clean":"2024-05-08T10:23:49.439093+0000","last_became_active":"2024-05-08T10:23:48.442172+0000","last_became_peered":"2024-05-08T10:23:48.442172+0000","last_unstale":"2024-05-08T10:23:49.439093+0000","last_undegraded":"2024-05-08T10:23:49.439093+0000","last_fullsized":"2024-05-08T10:23:49.439093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071141+0000","last_change":"2024-05-08T10:23:47.440567+0000","last_active":"2024-05-08T10:23:50.071141+0000","last_peered":"2024-05-08T10:23:50.071141+0000","last_clean":"2024-05-08T10:23:50.071141+0000","last_became_active":"2024-05-08T10:23:47.440075+0000","last_became_peered":"2024-05-08T10:23:47.440075+0000","last_unstale":"2024-05-08T10:23:50.071141+0000","last_undegraded":"2024-05-08T10:23:50.071141+0000","last_fullsized":"2024-05-08T10:23:50.071141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440323+0000","last_change":"2024-05-08T10:23:48.440957+0000","last_active":"2024-05-08T10:23:49.440323+0000","last_peered":"2024-05-08T10:23:49.440323+0000","last_clean":"2024-05-08T10:23:49.440323+0000","last_became_active":"2024-05-08T10:23:48.440668+0000","last_became_peered":"2024-05-08T10:23:48.440668+0000","last_unstale":"2024-05-08T10:23:49.440323+0000","last_undegraded":"2024-05-08T10:23:49.440323+0000","last_fullsized":"2024-05-08T10:23:49.440323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:42.025883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439618+0000","last_change":"2024-05-08T10:23:47.439238+0000","last_active":"2024-05-08T10:23:49.439618+0000","last_peered":"2024-05-08T10:23:49.439618+0000","last_clean":"2024-05-08T10:23:49.439618+0000","last_became_active":"2024-05-08T10:23:47.438965+0000","last_became_peered":"2024-05-08T10:23:47.438965+0000","last_unstale":"2024-05-08T10:23:49.439618+0000","last_undegraded":"2024-05-08T10:23:49.439618+0000","last_fullsized":"2024-05-08T10:23:49.439618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:08.211133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071825+0000","last_change":"2024-05-08T10:23:48.449865+0000","last_active":"2024-05-08T10:23:50.071825+0000","last_peered":"2024-05-08T10:23:50.071825+0000","last_clean":"2024-05-08T10:23:50.071825+0000","last_became_active":"2024-05-08T10:23:48.449534+0000","last_became_peered":"2024-05-08T10:23:48.449534+0000","last_unstale":"2024-05-08T10:23:50.071825+0000","last_undegraded":"2024-05-08T10:23:50.071825+0000","last_fullsized":"2024-05-08T10:23:50.071825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:58.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072152+0000","last_change":"2024-05-08T10:23:47.443886+0000","last_active":"2024-05-08T10:23:50.072152+0000","last_peered":"2024-05-08T10:23:50.072152+0000","last_clean":"2024-05-08T10:23:50.072152+0000","last_became_active":"2024-05-08T10:23:47.443654+0000","last_became_peered":"2024-05-08T10:23:47.443654+0000","last_unstale":"2024-05-08T10:23:50.072152+0000","last_undegraded":"2024-05-08T10:23:50.072152+0000","last_fullsized":"2024-05-08T10:23:50.072152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:30.687087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439533+0000","last_change":"2024-05-08T10:23:48.444924+0000","last_active":"2024-05-08T10:23:49.439533+0000","last_peered":"2024-05-08T10:23:49.439533+0000","last_clean":"2024-05-08T10:23:49.439533+0000","last_became_active":"2024-05-08T10:23:48.444666+0000","last_became_peered":"2024-05-08T10:23:48.444666+0000","last_unstale":"2024-05-08T10:23:49.439533+0000","last_undegraded":"2024-05-08T10:23:49.439533+0000","last_fullsized":"2024-05-08T10:23:49.439533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439457+0000","last_change":"2024-05-08T10:23:47.440367+0000","last_active":"2024-05-08T10:23:49.439457+0000","last_peered":"2024-05-08T10:23:49.439457+0000","last_clean":"2024-05-08T10:23:49.439457+0000","last_became_active":"2024-05-08T10:23:47.440098+0000","last_became_peered":"2024-05-08T10:23:47.440098+0000","last_unstale":"2024-05-08T10:23:49.439457+0000","last_undegraded":"2024-05-08T10:23:49.439457+0000","last_fullsized":"2024-05-08T10:23:49.439457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071073+0000","last_change":"2024-05-08T10:23:48.451970+0000","last_active":"2024-05-08T10:23:50.071073+0000","last_peered":"2024-05-08T10:23:50.071073+0000","last_clean":"2024-05-08T10:23:50.071073+0000","last_became_active":"2024-05-08T10:23:48.451718+0000","last_became_peered":"2024-05-08T10:23:48.451718+0000","last_unstale":"2024-05-08T10:23:50.071073+0000","last_undegraded":"2024-05-08T10:23:50.071073+0000","last_fullsized":"2024-05-08T10:23:50.071073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070016+0000","last_change":"2024-05-08T10:23:47.441809+0000","last_active":"2024-05-08T10:23:50.070016+0000","last_peered":"2024-05-08T10:23:50.070016+0000","last_clean":"2024-05-08T10:23:50.070016+0000","last_became_active":"2024-05-08T10:23:47.441527+0000","last_became_peered":"2024-05-08T10:23:47.441527+0000","last_unstale":"2024-05-08T10:23:50.070016+0000","last_undegraded":"2024-05-08T10:23:50.070016+0000","last_fullsized":"2024-05-08T10:23:50.070016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071600+0000","last_change":"2024-05-08T10:23:48.449529+0000","last_active":"2024-05-08T10:23:50.071600+0000","last_peered":"2024-05-08T10:23:50.071600+0000","last_clean":"2024-05-08T10:23:50.071600+0000","last_became_active":"2024-05-08T10:23:48.449277+0000","last_became_peered":"2024-05-08T10:23:48.449277+0000","last_unstale":"2024-05-08T10:23:50.071600+0000","last_undegraded":"2024-05-08T10:23:50.071600+0000","last_fullsized":"2024-05-08T10:23:50.071600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071278+0000","last_change":"2024-05-08T10:23:47.443969+0000","last_active":"2024-05-08T10:23:50.071278+0000","last_peered":"2024-05-08T10:23:50.071278+0000","last_clean":"2024-05-08T10:23:50.071278+0000","last_became_active":"2024-05-08T10:23:47.443699+0000","last_became_peered":"2024-05-08T10:23:47.443699+0000","last_unstale":"2024-05-08T10:23:50.071278+0000","last_undegraded":"2024-05-08T10:23:50.071278+0000","last_fullsized":"2024-05-08T10:23:50.071278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440154+0000","last_change":"2024-05-08T10:23:48.434030+0000","last_active":"2024-05-08T10:23:49.440154+0000","last_peered":"2024-05-08T10:23:49.440154+0000","last_clean":"2024-05-08T10:23:49.440154+0000","last_became_active":"2024-05-08T10:23:48.432607+0000","last_became_peered":"2024-05-08T10:23:48.432607+0000","last_unstale":"2024-05-08T10:23:49.440154+0000","last_undegraded":"2024-05-08T10:23:49.440154+0000","last_fullsized":"2024-05-08T10:23:49.440154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:49.151330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439287+0000","last_change":"2024-05-08T10:23:47.441563+0000","last_active":"2024-05-08T10:23:49.439287+0000","last_peered":"2024-05-08T10:23:49.439287+0000","last_clean":"2024-05-08T10:23:49.439287+0000","last_became_active":"2024-05-08T10:23:47.441300+0000","last_became_peered":"2024-05-08T10:23:47.441300+0000","last_unstale":"2024-05-08T10:23:49.439287+0000","last_undegraded":"2024-05-08T10:23:49.439287+0000","last_fullsized":"2024-05-08T10:23:49.439287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070974+0000","last_change":"2024-05-08T10:23:48.447037+0000","last_active":"2024-05-08T10:23:50.070974+0000","last_peered":"2024-05-08T10:23:50.070974+0000","last_clean":"2024-05-08T10:23:50.070974+0000","last_became_active":"2024-05-08T10:23:48.446758+0000","last_became_peered":"2024-05-08T10:23:48.446758+0000","last_unstale":"2024-05-08T10:23:50.070974+0000","last_undegraded":"2024-05-08T10:23:50.070974+0000","last_fullsized":"2024-05-08T10:23:50.070974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439217+0000","last_change":"2024-05-08T10:23:47.438095+0000","last_active":"2024-05-08T10:23:49.439217+0000","last_peered":"2024-05-08T10:23:49.439217+0000","last_clean":"2024-05-08T10:23:49.439217+0000","last_became_active":"2024-05-08T10:23:47.437623+0000","last_became_peered":"2024-05-08T10:23:47.437623+0000","last_unstale":"2024-05-08T10:23:49.439217+0000","last_undegraded":"2024-05-08T10:23:49.439217+0000","last_fullsized":"2024-05-08T10:23:49.439217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071504+0000","last_change":"2024-05-08T10:23:48.440080+0000","last_active":"2024-05-08T10:23:50.071504+0000","last_peered":"2024-05-08T10:23:50.071504+0000","last_clean":"2024-05-08T10:23:50.071504+0000","last_became_active":"2024-05-08T10:23:48.439806+0000","last_became_peered":"2024-05-08T10:23:48.439806+0000","last_unstale":"2024-05-08T10:23:50.071504+0000","last_undegraded":"2024-05-08T10:23:50.071504+0000","last_fullsized":"2024-05-08T10:23:50.071504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:53:25.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071944+0000","last_change":"2024-05-08T10:23:47.441909+0000","last_active":"2024-05-08T10:23:50.071944+0000","last_peered":"2024-05-08T10:23:50.071944+0000","last_clean":"2024-05-08T10:23:50.071944+0000","last_became_active":"2024-05-08T10:23:47.441503+0000","last_became_peered":"2024-05-08T10:23:47.441503+0000","last_unstale":"2024-05-08T10:23:50.071944+0000","last_undegraded":"2024-05-08T10:23:50.071944+0000","last_fullsized":"2024-05-08T10:23:50.071944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:03.877856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069602+0000","last_change":"2024-05-08T10:23:48.442495+0000","last_active":"2024-05-08T10:23:50.069602+0000","last_peered":"2024-05-08T10:23:50.069602+0000","last_clean":"2024-05-08T10:23:50.069602+0000","last_became_active":"2024-05-08T10:23:48.442219+0000","last_became_peered":"2024-05-08T10:23:48.442219+0000","last_unstale":"2024-05-08T10:23:50.069602+0000","last_undegraded":"2024-05-08T10:23:50.069602+0000","last_fullsized":"2024-05-08T10:23:50.069602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071714+0000","last_change":"2024-05-08T10:23:48.450618+0000","last_active":"2024-05-08T10:23:50.071714+0000","last_peered":"2024-05-08T10:23:50.071714+0000","last_clean":"2024-05-08T10:23:50.071714+0000","last_became_active":"2024-05-08T10:23:48.450339+0000","last_became_peered":"2024-05-08T10:23:48.450339+0000","last_unstale":"2024-05-08T10:23:50.071714+0000","last_undegraded":"2024-05-08T10:23:50.071714+0000","last_fullsized":"2024-05-08T10:23:50.071714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:16.618080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072177+0000","last_change":"2024-05-08T10:23:47.439945+0000","last_active":"2024-05-08T10:23:50.072177+0000","last_peered":"2024-05-08T10:23:50.072177+0000","last_clean":"2024-05-08T10:23:50.072177+0000","last_became_active":"2024-05-08T10:23:47.439631+0000","last_became_peered":"2024-05-08T10:23:47.439631+0000","last_unstale":"2024-05-08T10:23:50.072177+0000","last_undegraded":"2024-05-08T10:23:50.072177+0000","last_fullsized":"2024-05-08T10:23:50.072177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071282+0000","last_change":"2024-05-08T10:23:48.449884+0000","last_active":"2024-05-08T10:23:50.071282+0000","last_peered":"2024-05-08T10:23:50.071282+0000","last_clean":"2024-05-08T10:23:50.071282+0000","last_became_active":"2024-05-08T10:23:48.449628+0000","last_became_peered":"2024-05-08T10:23:48.449628+0000","last_unstale":"2024-05-08T10:23:50.071282+0000","last_undegraded":"2024-05-08T10:23:50.071282+0000","last_fullsized":"2024-05-08T10:23:50.071282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.646809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071959+0000","last_change":"2024-05-08T10:23:47.442600+0000","last_active":"2024-05-08T10:23:50.071959+0000","last_peered":"2024-05-08T10:23:50.071959+0000","last_clean":"2024-05-08T10:23:50.071959+0000","last_became_active":"2024-05-08T10:23:47.441385+0000","last_became_peered":"2024-05-08T10:23:47.441385+0000","last_unstale":"2024-05-08T10:23:50.071959+0000","last_undegraded":"2024-05-08T10:23:50.071959+0000","last_fullsized":"2024-05-08T10:23:50.071959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:08.211133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071411+0000","last_change":"2024-05-08T10:23:48.451860+0000","last_active":"2024-05-08T10:23:50.071411+0000","last_peered":"2024-05-08T10:23:50.071411+0000","last_clean":"2024-05-08T10:23:50.071411+0000","last_became_active":"2024-05-08T10:23:48.451546+0000","last_became_peered":"2024-05-08T10:23:48.451546+0000","last_unstale":"2024-05-08T10:23:50.071411+0000","last_undegraded":"2024-05-08T10:23:50.071411+0000","last_fullsized":"2024-05-08T10:23:50.071411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:57.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071239+0000","last_change":"2024-05-08T10:23:47.435845+0000","last_active":"2024-05-08T10:23:50.071239+0000","last_peered":"2024-05-08T10:23:50.071239+0000","last_clean":"2024-05-08T10:23:50.071239+0000","last_became_active":"2024-05-08T10:23:47.435557+0000","last_became_peered":"2024-05-08T10:23:47.435557+0000","last_unstale":"2024-05-08T10:23:50.071239+0000","last_undegraded":"2024-05-08T10:23:50.071239+0000","last_fullsized":"2024-05-08T10:23:50.071239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071173+0000","last_change":"2024-05-08T10:23:48.446164+0000","last_active":"2024-05-08T10:23:50.071173+0000","last_peered":"2024-05-08T10:23:50.071173+0000","last_clean":"2024-05-08T10:23:50.071173+0000","last_became_active":"2024-05-08T10:23:48.445903+0000","last_became_peered":"2024-05-08T10:23:48.445903+0000","last_unstale":"2024-05-08T10:23:50.071173+0000","last_undegraded":"2024-05-08T10:23:50.071173+0000","last_fullsized":"2024-05-08T10:23:50.071173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:17.618922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071638+0000","last_change":"2024-05-08T10:23:47.439956+0000","last_active":"2024-05-08T10:23:50.071638+0000","last_peered":"2024-05-08T10:23:50.071638+0000","last_clean":"2024-05-08T10:23:50.071638+0000","last_became_active":"2024-05-08T10:23:47.439661+0000","last_became_peered":"2024-05-08T10:23:47.439661+0000","last_unstale":"2024-05-08T10:23:50.071638+0000","last_undegraded":"2024-05-08T10:23:50.071638+0000","last_fullsized":"2024-05-08T10:23:50.071638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:23:56.165 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T10:23:56.165 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T10:23:56.166 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T10:23:56.166 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T10:23:56.166 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T10:23:56.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.342+0000 7fc178c6d640 1 Processor -- start 2024-05-08T10:23:56.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.342+0000 7fc178c6d640 1 -- start start 2024-05-08T10:23:56.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc178c6d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1741423c0 0x7fc174142a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc178c6d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc174163800 0x7fc1740d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc178c6d640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc174142f50 con 0x7fc1740d3830 2024-05-08T10:23:56.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc178c6d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc1741608b0 con 0x7fc174163800 2024-05-08T10:23:56.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc178c6d640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc1740d3ca0 con 0x7fc1741423c0 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc16bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc174163800 0x7fc1740d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc16bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc174163800 0x7fc1740d32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35904/0 (socket says 172.21.15.143:35904) 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc16bfff640 1 -- 172.21.15.143:0/629560170 learned_addr learned my addr 172.21.15.143:0/629560170 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc17259c640 1 --2- 172.21.15.143:0/629560170 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1741423c0 0x7fc174142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc16bfff640 1 -- 172.21.15.143:0/629560170 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1741423c0 msgr2=0x7fc174142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc16bfff640 1 --2- 172.21.15.143:0/629560170 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1741423c0 0x7fc174142a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc16bfff640 1 -- 172.21.15.143:0/629560170 >> v1:172.21.15.163:6789/0 conn(0x7fc1740d3830 legacy=0x7fc174144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc16bfff640 1 -- 172.21.15.143:0/629560170 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17415fca0 con 0x7fc174163800 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.343+0000 7fc17259c640 1 --2- 172.21.15.143:0/629560170 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1741423c0 0x7fc174142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc16bfff640 1 --2- 172.21.15.143:0/629560170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc174163800 0x7fc1740d32f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009870 tx=0x7fc15c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2f0943cd59575 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc171d9b640 1 -- 172.21.15.143:0/629560170 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c037070 con 0x7fc174163800 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc171d9b640 1 -- 172.21.15.143:0/629560170 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c032440 con 0x7fc174163800 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc171d9b640 1 -- 172.21.15.143:0/629560170 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c032810 con 0x7fc174163800 2024-05-08T10:23:56.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc178c6d640 1 -- 172.21.15.143:0/629560170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc174163800 msgr2=0x7fc1740d32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc178c6d640 1 --2- 172.21.15.143:0/629560170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc174163800 0x7fc1740d32f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009870 tx=0x7fc15c02a1c0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc178c6d640 1 -- 172.21.15.143:0/629560170 shutdown_connections 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc178c6d640 1 --2- 172.21.15.143:0/629560170 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc174163800 0x7fc1740d32f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc178c6d640 1 --2- 172.21.15.143:0/629560170 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1741423c0 0x7fc174142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc178c6d640 1 -- 172.21.15.143:0/629560170 >> 172.21.15.143:0/629560170 conn(0x7fc1740682f0 msgr2=0x7fc174068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc178c6d640 1 -- 172.21.15.143:0/629560170 shutdown_connections 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.344+0000 7fc178c6d640 1 -- 172.21.15.143:0/629560170 wait complete. 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.346+0000 7fc178c6d640 1 Processor -- start 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.346+0000 7fc178c6d640 1 -- start start 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.346+0000 7fc178c6d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1740d3830 0x7fc1740ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.346+0000 7fc178c6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1741423c0 0x7fc1741f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.346+0000 7fc178c6d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc174163800 0x7fc1741406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.346+0000 7fc178c6d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc174160540 con 0x7fc1741423c0 2024-05-08T10:23:56.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.346+0000 7fc178c6d640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc174160260 con 0x7fc174163800 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc178c6d640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc1741630a0 con 0x7fc1740d3830 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1741423c0 0x7fc1741f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1741423c0 0x7fc1741f5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35918/0 (socket says 172.21.15.143:35918) 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16bfff640 1 -- 172.21.15.143:0/582270236 learned_addr learned my addr 172.21.15.143:0/582270236 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc17259c640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1740d3830 0x7fc1740ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc172d9d640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc174163800 0x7fc1741406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16bfff640 1 -- 172.21.15.143:0/582270236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1740d3830 msgr2=0x7fc1740ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16bfff640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1740d3830 0x7fc1740ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16bfff640 1 -- 172.21.15.143:0/582270236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc174163800 msgr2=0x7fc1741406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16bfff640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc174163800 0x7fc1741406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16bfff640 1 -- 172.21.15.143:0/582270236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1740cf2b0 con 0x7fc1741423c0 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc172d9d640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc174163800 0x7fc1741406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16bfff640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1741423c0 0x7fc1741f5c90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc15c02a200 tx=0x7fc15c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:56.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16affd640 1 -- 172.21.15.143:0/582270236 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c037040 con 0x7fc1741423c0 2024-05-08T10:23:56.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16affd640 1 -- 172.21.15.143:0/582270236 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c042070 con 0x7fc1741423c0 2024-05-08T10:23:56.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1740cefd0 con 0x7fc1741423c0 2024-05-08T10:23:56.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc16affd640 1 -- 172.21.15.143:0/582270236 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c030bd0 con 0x7fc1741423c0 2024-05-08T10:23:56.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.347+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1740b3190 con 0x7fc1741423c0 2024-05-08T10:23:56.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.348+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc174075dc0 con 0x7fc1741423c0 2024-05-08T10:23:56.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.349+0000 7fc16affd640 1 -- 172.21.15.143:0/582270236 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc15c02ad10 con 0x7fc1741423c0 2024-05-08T10:23:56.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.349+0000 7fc16affd640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1540762d0 0x7fc154078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.349+0000 7fc17259c640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1540762d0 0x7fc154078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.349+0000 7fc16affd640 1 -- 172.21.15.143:0/582270236 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc15c0b7f00 con 0x7fc1741423c0 2024-05-08T10:23:56.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.350+0000 7fc17259c640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1540762d0 0x7fc154078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1740689d0 tx=0x7fc164008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:56.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.353+0000 7fc16affd640 1 -- 172.21.15.143:0/582270236 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc15c0818f0 con 0x7fc1741423c0 2024-05-08T10:23:56.572 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.587+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc17406a550 con 0x7fc1741423c0 2024-05-08T10:23:56.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.590+0000 7fc16affd640 1 -- 172.21.15.143:0/582270236 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189527 (secure 0 0 0) 0x7fc15c0811f0 con 0x7fc1741423c0 2024-05-08T10:23:56.577 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1540762d0 msgr2=0x7fc154078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1540762d0 0x7fc154078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1740689d0 tx=0x7fc164008040 comp rx=0 tx=0).stop 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1741423c0 msgr2=0x7fc1741f5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1741423c0 0x7fc1741f5c90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc15c02a200 tx=0x7fc15c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 shutdown_connections 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc174163800 0x7fc1741406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1540762d0 0x7fc154078790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1741423c0 0x7fc1741f5c90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 --2- 172.21.15.143:0/582270236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1740d3830 0x7fc1740ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 >> 172.21.15.143:0/582270236 conn(0x7fc1740682f0 msgr2=0x7fc174161c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:56.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 shutdown_connections 2024-05-08T10:23:56.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.593+0000 7fc178c6d640 1 -- 172.21.15.143:0/582270236 wait complete. 2024-05-08T10:23:56.589 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2824092200},{"type":"v1","addr":"172.21.15.143:6833","nonce":2824092200}]},"active_addr":"172.21.15.143:6833/2824092200","active_change":"2024-05-08T10:23:36.518326+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":1126466870}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":1962266363}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":3850245186}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":441657010}]}]} 2024-05-08T10:23:56.593 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T10:23:56.593 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T10:23:56.593 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:23:56.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.708+0000 7faf35845640 1 Processor -- start 2024-05-08T10:23:56.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.708+0000 7faf35845640 1 -- start start 2024-05-08T10:23:56.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf35845640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf3015f3a0 0x7faf300d5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf35845640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faf300d2340 0x7faf3006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf35845640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3015f780 con 0x7faf30163bd0 2024-05-08T10:23:56.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf35845640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7faf300d0a40 con 0x7faf300d2340 2024-05-08T10:23:56.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf35845640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7faf300d0110 con 0x7faf3015f3a0 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf2f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faf300d2340 0x7faf3006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf2f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faf300d2340 0x7faf3006d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35926/0 (socket says 172.21.15.143:35926) 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf2f7fe640 1 -- 172.21.15.143:0/2021866826 learned_addr learned my addr 172.21.15.143:0/2021866826 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf2f7fe640 1 -- 172.21.15.143:0/2021866826 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf3015f3a0 msgr2=0x7faf300d5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf2f7fe640 1 --2- 172.21.15.143:0/2021866826 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf3015f3a0 0x7faf300d5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf2f7fe640 1 -- 172.21.15.143:0/2021866826 >> v1:172.21.15.163:6789/0 conn(0x7faf30163bd0 legacy=0x7faf300d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.709+0000 7faf2f7fe640 1 -- 172.21.15.143:0/2021866826 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf300d03f0 con 0x7faf300d2340 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.710+0000 7faf2f7fe640 1 --2- 172.21.15.143:0/2021866826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf300d2340 0x7faf3006d3e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf300d0bc0 tx=0x7faf2802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7368cdcffda17ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.710+0000 7faf2dffb640 1 -- 172.21.15.143:0/2021866826 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28037070 con 0x7faf300d2340 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.710+0000 7faf2dffb640 1 -- 172.21.15.143:0/2021866826 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf28032440 con 0x7faf300d2340 2024-05-08T10:23:56.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.710+0000 7faf2dffb640 1 -- 172.21.15.143:0/2021866826 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28032810 con 0x7faf300d2340 2024-05-08T10:23:56.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.711+0000 7faf35845640 1 -- 172.21.15.143:0/2021866826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf300d2340 msgr2=0x7faf3006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.711+0000 7faf35845640 1 --2- 172.21.15.143:0/2021866826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf300d2340 0x7faf3006d3e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf300d0bc0 tx=0x7faf2802a1a0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.711+0000 7faf35845640 1 -- 172.21.15.143:0/2021866826 shutdown_connections 2024-05-08T10:23:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.711+0000 7faf35845640 1 --2- 172.21.15.143:0/2021866826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf300d2340 0x7faf3006d3e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.711+0000 7faf35845640 1 --2- 172.21.15.143:0/2021866826 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf3015f3a0 0x7faf300d5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.711+0000 7faf35845640 1 -- 172.21.15.143:0/2021866826 >> 172.21.15.143:0/2021866826 conn(0x7faf3009e5b0 msgr2=0x7faf300d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.711+0000 7faf35845640 1 -- 172.21.15.143:0/2021866826 shutdown_connections 2024-05-08T10:23:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.711+0000 7faf35845640 1 -- 172.21.15.143:0/2021866826 wait complete. 2024-05-08T10:23:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.712+0000 7faf35845640 1 Processor -- start 2024-05-08T10:23:56.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.712+0000 7faf35845640 1 -- start start 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf35845640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf300d2340 0x7faf301eb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf35845640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf3015f3a0 0x7faf300cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf35845640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30163bd0 0x7faf300ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf35845640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faf300d5e70 con 0x7faf30163bd0 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf35845640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7faf300cfdc0 con 0x7faf300d2340 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf35845640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7faf300d5ff0 con 0x7faf3015f3a0 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30163bd0 0x7faf300ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30163bd0 0x7faf300ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35934/0 (socket says 172.21.15.143:35934) 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2f7fe640 1 -- 172.21.15.143:0/2064907003 learned_addr learned my addr 172.21.15.143:0/2064907003 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:56.701 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2effd640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf300d2340 0x7faf301eb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2e7fc640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf3015f3a0 0x7faf300cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2f7fe640 1 -- 172.21.15.143:0/2064907003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf3015f3a0 msgr2=0x7faf300cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2f7fe640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf3015f3a0 0x7faf300cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2f7fe640 1 -- 172.21.15.143:0/2064907003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf300d2340 msgr2=0x7faf301eb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2f7fe640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf300d2340 0x7faf301eb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2f7fe640 1 -- 172.21.15.143:0/2064907003 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf301eb9a0 con 0x7faf30163bd0 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.713+0000 7faf2f7fe640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30163bd0 0x7faf300ccb20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf280090b0 tx=0x7faf280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.714+0000 7faf17fff640 1 -- 172.21.15.143:0/2064907003 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28041070 con 0x7faf30163bd0 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.714+0000 7faf17fff640 1 -- 172.21.15.143:0/2064907003 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2803c950 con 0x7faf30163bd0 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.714+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf300b7720 con 0x7faf30163bd0 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.714+0000 7faf17fff640 1 -- 172.21.15.143:0/2064907003 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28037040 con 0x7faf30163bd0 2024-05-08T10:23:56.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.714+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf300cf310 con 0x7faf30163bd0 2024-05-08T10:23:56.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.715+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf3006a550 con 0x7faf30163bd0 2024-05-08T10:23:56.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.715+0000 7faf17fff640 1 -- 172.21.15.143:0/2064907003 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faf28044070 con 0x7faf30163bd0 2024-05-08T10:23:56.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.716+0000 7faf17fff640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faf1c0762d0 0x7faf1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:56.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.716+0000 7faf2effd640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faf1c0762d0 0x7faf1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:56.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.716+0000 7faf17fff640 1 -- 172.21.15.143:0/2064907003 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faf280b8090 con 0x7faf30163bd0 2024-05-08T10:23:56.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.716+0000 7faf2effd640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faf1c0762d0 0x7faf1c078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf3015b1c0 tx=0x7faf200094f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:56.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.720+0000 7faf17fff640 1 -- 172.21.15.143:0/2064907003 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faf280819f0 con 0x7faf30163bd0 2024-05-08T10:23:56.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.905+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf30069780 con 0x7faf30163bd0 2024-05-08T10:23:56.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.906+0000 7faf17fff640 1 -- 172.21.15.143:0/2064907003 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7faf280812f0 con 0x7faf30163bd0 2024-05-08T10:23:56.891 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:56.892 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:49.433403+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:23:45.992622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:23:46.737514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:23:56.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faf1c0762d0 msgr2=0x7faf1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faf1c0762d0 0x7faf1c078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf3015b1c0 tx=0x7faf200094f0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30163bd0 msgr2=0x7faf300ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:56.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30163bd0 0x7faf300ccb20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf280090b0 tx=0x7faf280046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 shutdown_connections 2024-05-08T10:23:56.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faf1c0762d0 0x7faf1c078790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30163bd0 0x7faf300ccb20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf3015f3a0 0x7faf300cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 --2- 172.21.15.143:0/2064907003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf300d2340 0x7faf301eb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:56.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 >> 172.21.15.143:0/2064907003 conn(0x7faf3009e5b0 msgr2=0x7faf3015d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:56.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 shutdown_connections 2024-05-08T10:23:56.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:56.908+0000 7faf35845640 1 -- 172.21.15.143:0/2064907003 wait complete. 2024-05-08T10:23:56.905 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T10:23:56.905 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:23:57.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.020+0000 7fb150f71640 1 Processor -- start 2024-05-08T10:23:57.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.020+0000 7fb150f71640 1 -- start start 2024-05-08T10:23:57.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.021+0000 7fb150f71640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c0b48b0 0x7fb14c166ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.021+0000 7fb150f71640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14c072f80 con 0x7fb14c0ae180 2024-05-08T10:23:57.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.021+0000 7fb150f71640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14c074430 con 0x7fb14c15c020 2024-05-08T10:23:57.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.021+0000 7fb150f71640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c0ae700 con 0x7fb14c0b48b0 2024-05-08T10:23:57.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.021+0000 7fb149d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb14c0ae180 0x7fb14c0b41a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38996/0 (socket says 172.21.15.143:38996) 2024-05-08T10:23:57.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.021+0000 7fb149d9b640 1 -- 172.21.15.143:0/3911557914 learned_addr learned my addr 172.21.15.143:0/3911557914 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:57.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.021+0000 7fb14ad9d640 1 --2- 172.21.15.143:0/3911557914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c0b48b0 0x7fb14c166ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.021+0000 7fb14959a640 1 -- 172.21.15.143:0/3911557914 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635026334 0 0) 0x7fb140001110 con 0x7fb14c0ae180 2024-05-08T10:23:57.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.022+0000 7fb14959a640 1 -- 172.21.15.143:0/3911557914 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb134003520 con 0x7fb14c0ae180 2024-05-08T10:23:57.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.022+0000 7fb14959a640 1 -- 172.21.15.143:0/3911557914 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683809874 0 0) 0x7fb14c074430 con 0x7fb14c15c020 2024-05-08T10:23:57.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.022+0000 7fb14959a640 1 -- 172.21.15.143:0/3911557914 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb140001110 con 0x7fb14c15c020 2024-05-08T10:23:57.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.022+0000 7fb14959a640 1 -- 172.21.15.143:0/3911557914 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2686463556 0 0) 0x7fb134003520 con 0x7fb14c0ae180 2024-05-08T10:23:57.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.022+0000 7fb14ad9d640 1 -- 172.21.15.143:0/3911557914 >> v1:172.21.15.163:6789/0 conn(0x7fb14c15c020 legacy=0x7fb14c073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.022+0000 7fb14ad9d640 1 -- 172.21.15.143:0/3911557914 >> v1:172.21.15.143:6789/0 conn(0x7fb14c0ae180 legacy=0x7fb14c0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.022+0000 7fb14ad9d640 1 -- 172.21.15.143:0/3911557914 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c074710 con 0x7fb14c0b48b0 2024-05-08T10:23:57.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.022+0000 7fb14ad9d640 1 --2- 172.21.15.143:0/3911557914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c0b48b0 0x7fb14c166ca0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb144009dc0 tx=0x7fb14402a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be5132a09063d5f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb14959a640 1 -- 172.21.15.143:0/3911557914 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1400018c0 con 0x7fb14c0b48b0 2024-05-08T10:23:57.009 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb14959a640 1 -- 172.21.15.143:0/3911557914 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb144007540 con 0x7fb14c0b48b0 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb14959a640 1 -- 172.21.15.143:0/3911557914 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144007910 con 0x7fb14c0b48b0 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb150f71640 1 -- 172.21.15.143:0/3911557914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c0b48b0 msgr2=0x7fb14c166ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb150f71640 1 --2- 172.21.15.143:0/3911557914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c0b48b0 0x7fb14c166ca0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb144009dc0 tx=0x7fb14402a540 comp rx=0 tx=0).stop 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb150f71640 1 -- 172.21.15.143:0/3911557914 shutdown_connections 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb150f71640 1 --2- 172.21.15.143:0/3911557914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c0b48b0 0x7fb14c166ca0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb150f71640 1 -- 172.21.15.143:0/3911557914 >> 172.21.15.143:0/3911557914 conn(0x7fb14c06c500 msgr2=0x7fb14c06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb150f71640 1 -- 172.21.15.143:0/3911557914 shutdown_connections 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.023+0000 7fb150f71640 1 -- 172.21.15.143:0/3911557914 wait complete. 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.024+0000 7fb150f71640 1 Processor -- start 2024-05-08T10:23:57.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb150f71640 1 -- start start 2024-05-08T10:23:57.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb150f71640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb14c0ae180 0x7fb14c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb150f71640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb14c0b48b0 0x7fb14c1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb150f71640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c15c020 0x7fb14c06f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb150f71640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c15c400 con 0x7fb14c0b48b0 2024-05-08T10:23:57.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb150f71640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c073290 con 0x7fb14c0ae180 2024-05-08T10:23:57.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb150f71640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c1671e0 con 0x7fb14c15c020 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb149d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb14c0b48b0 0x7fb14c1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb149d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb14c0b48b0 0x7fb14c1523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35940/0 (socket says 172.21.15.143:35940) 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.025+0000 7fb149d9b640 1 -- 172.21.15.143:0/3491134332 learned_addr learned my addr 172.21.15.143:0/3491134332 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb14ad9d640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c15c020 0x7fb14c06f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb14a59c640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb14c0ae180 0x7fb14c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb149d9b640 1 -- 172.21.15.143:0/3491134332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c15c020 msgr2=0x7fb14c06f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb149d9b640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c15c020 0x7fb14c06f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb149d9b640 1 -- 172.21.15.143:0/3491134332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb14c0ae180 msgr2=0x7fb14c1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb149d9b640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb14c0ae180 0x7fb14c1531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb149d9b640 1 -- 172.21.15.143:0/3491134332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c151350 con 0x7fb14c0b48b0 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb149d9b640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb14c0b48b0 0x7fb14c1523b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c7b0 tx=0x7fb14000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb13affd640 1 -- 172.21.15.143:0/3491134332 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140017070 con 0x7fb14c0b48b0 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb13affd640 1 -- 172.21.15.143:0/3491134332 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb140005af0 con 0x7fb14c0b48b0 2024-05-08T10:23:57.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c153710 con 0x7fb14c0b48b0 2024-05-08T10:23:57.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb13affd640 1 -- 172.21.15.143:0/3491134332 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140007070 con 0x7fb14c0b48b0 2024-05-08T10:23:57.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.026+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c1518d0 con 0x7fb14c0b48b0 2024-05-08T10:23:57.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.027+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14c06a550 con 0x7fb14c0b48b0 2024-05-08T10:23:57.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.028+0000 7fb13affd640 1 -- 172.21.15.143:0/3491134332 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb14001a070 con 0x7fb14c0b48b0 2024-05-08T10:23:57.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.028+0000 7fb13affd640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb12c0762d0 0x7fb12c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.028+0000 7fb14a59c640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb12c0762d0 0x7fb12c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.028+0000 7fb13affd640 1 -- 172.21.15.143:0/3491134332 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb140096bf0 con 0x7fb14c0b48b0 2024-05-08T10:23:57.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.029+0000 7fb14a59c640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb12c0762d0 0x7fb12c078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb13c001120 tx=0x7fb13c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.032+0000 7fb13affd640 1 -- 172.21.15.143:0/3491134332 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb14c072f80 con 0x7fb14c0b48b0 2024-05-08T10:23:57.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.213+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb14c0b27a0 con 0x7fb14c0b48b0 2024-05-08T10:23:57.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.214+0000 7fb13affd640 1 -- 172.21.15.143:0/3491134332 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fb140060550 con 0x7fb14c0b48b0 2024-05-08T10:23:57.199 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:23:57.199 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:49.433403+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:23:45.992622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:23:46.737514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:23:57.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb12c0762d0 msgr2=0x7fb12c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb12c0762d0 0x7fb12c078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb13c001120 tx=0x7fb13c009040 comp rx=0 tx=0).stop 2024-05-08T10:23:57.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb14c0b48b0 msgr2=0x7fb14c1523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb14c0b48b0 0x7fb14c1523b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c7b0 tx=0x7fb14000cc70 comp rx=0 tx=0).stop 2024-05-08T10:23:57.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 shutdown_connections 2024-05-08T10:23:57.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb14c15c020 0x7fb14c06f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb12c0762d0 0x7fb12c078790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb14c0b48b0 0x7fb14c1523b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 --2- 172.21.15.143:0/3491134332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb14c0ae180 0x7fb14c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 >> 172.21.15.143:0/3491134332 conn(0x7fb14c06c500 msgr2=0x7fb14c160480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 shutdown_connections 2024-05-08T10:23:57.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.216+0000 7fb150f71640 1 -- 172.21.15.143:0/3491134332 wait complete. 2024-05-08T10:23:57.213 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T10:23:57.213 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T10:23:57.214 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T10:23:57.214 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T10:23:57.214 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T10:23:57.215 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T10:23:57.215 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T10:23:57.215 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T10:23:57.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.402+0000 7fd2d7367640 1 Processor -- start 2024-05-08T10:23:57.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.403+0000 7f2f3f600640 1 Processor -- start 2024-05-08T10:23:57.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.403+0000 7f74ecf90640 1 Processor -- start 2024-05-08T10:23:57.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.403+0000 7f74ecf90640 1 -- start start 2024-05-08T10:23:57.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.403+0000 7fd138e28640 1 Processor -- start 2024-05-08T10:23:57.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.403+0000 7fd138e28640 1 -- start start 2024-05-08T10:23:57.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.403+0000 7f2f3f600640 1 -- start start 2024-05-08T10:23:57.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.402+0000 7fd2d7367640 1 -- start start 2024-05-08T10:23:57.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7f1ca997f640 1 Processor -- start 2024-05-08T10:23:57.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fc70ccc2640 1 Processor -- start 2024-05-08T10:23:57.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7f1ca997f640 1 -- start start 2024-05-08T10:23:57.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fd2d7367640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2d00d1740 0x7fd2d00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fd2d7367640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd2d00b4c30 0x7fd2d00b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fd2d7367640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d0073930 con 0x7fd2d00d0680 2024-05-08T10:23:57.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fd2d7367640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d00b55e0 con 0x7fd2d00b4c30 2024-05-08T10:23:57.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fd2d7367640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d0073c10 con 0x7fd2d00d1740 2024-05-08T10:23:57.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fd2d6b66640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd2d00b4c30 0x7fd2d00b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7f74ecf90640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74e0050040 0x7f74e00542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7f74ecf90640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e0005ec0 con 0x7f74e0053e50 2024-05-08T10:23:57.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7f74ecf90640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e0053280 con 0x7f74e0048100 2024-05-08T10:23:57.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7f74ecf90640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f74e00e7b90 con 0x7f74e0050040 2024-05-08T10:23:57.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fd2d6b66640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd2d00b4c30 0x7fd2d00b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48398/0 (socket says 172.21.15.143:48398) 2024-05-08T10:23:57.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fd2d6b66640 1 -- 172.21.15.143:0/2773765897 learned_addr learned my addr 172.21.15.143:0/2773765897 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd2d6365640 1 --2- 172.21.15.143:0/2773765897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2d00d1740 0x7fd2d00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd2d6b66640 1 -- 172.21.15.143:0/2773765897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2d00d1740 msgr2=0x7fd2d00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f2f3f600640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2f38140100 0x7f2f38070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd138e28640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd13415b480 0x7fd1340727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f2f3f600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f38070bb0 0x7f2f38160e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f74e6d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74e0050040 0x7f74e00542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd138e28640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1340cefd0 0x7fd134072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f74e6d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74e0050040 0x7f74e00542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:58990/0 (socket says 172.21.15.143:58990) 2024-05-08T10:23:57.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f2f3f600640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f380d29d0 con 0x7f2f38161340 2024-05-08T10:23:57.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f2f3d39c640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2f38140100 0x7f2f38070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f2f3d39c640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2f38140100 0x7f2f38070670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48400/0 (socket says 172.21.15.143:48400) 2024-05-08T10:23:57.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f2f3f600640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2f3815d7a0 con 0x7f2f38140100 2024-05-08T10:23:57.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd138e28640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1340b4550 con 0x7fd13406fcb0 2024-05-08T10:23:57.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd138e28640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd1340b4830 con 0x7fd1340cefd0 2024-05-08T10:23:57.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd131d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1340cefd0 0x7fd134072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f2f3f600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2f38161b70 con 0x7f2f38070bb0 2024-05-08T10:23:57.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f2f3d39c640 1 -- 172.21.15.143:0/3133296061 learned_addr learned my addr 172.21.15.143:0/3133296061 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd131d9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1340cefd0 0x7fd134072d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35948/0 (socket says 172.21.15.143:35948) 2024-05-08T10:23:57.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd131d9b640 1 -- 172.21.15.143:0/397299329 learned_addr learned my addr 172.21.15.143:0/397299329 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd138e28640 1 -- 172.21.15.143:0/397299329 --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fd1340b4b10 con 0x7fd13415b480 2024-05-08T10:23:57.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f7ac6e2a640 1 Processor -- start 2024-05-08T10:23:57.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.404+0000 7fc70ccc2640 1 -- start start 2024-05-08T10:23:57.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fc70ccc2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7000e30c0 0x7fc700057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f7ac6e2a640 1 -- start start 2024-05-08T10:23:57.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fc70ccc2640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc70003e840 0x7fc700053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fc70ccc2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc700054130 0x7fc7000e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fc70ccc2640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc7000582d0 con 0x7fc700054130 2024-05-08T10:23:57.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fc70ccc2640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc700058570 con 0x7fc70003e840 2024-05-08T10:23:57.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fc70ccc2640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc700058850 con 0x7fc7000e30c0 2024-05-08T10:23:57.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fe292459640 1 Processor -- start 2024-05-08T10:23:57.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f2f3cb9b640 1 --2- 172.21.15.143:0/3133296061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f38070bb0 0x7f2f38160e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7000e30c0 0x7fc700057d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7000e30c0 0x7fc700057d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59010/0 (socket says 172.21.15.143:59010) 2024-05-08T10:23:57.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fc7077fe640 1 -- 172.21.15.143:0/3078616462 learned_addr learned my addr 172.21.15.143:0/3078616462 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fe292459640 1 -- start start 2024-05-08T10:23:57.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca997f640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1ca40cefd0 0x7f1ca4165ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd2d5363640 1 -- 172.21.15.143:0/2773765897 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004549663 0 0) 0x7fd2d0073930 con 0x7fd2d00d0680 2024-05-08T10:23:57.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd2d6b66640 1 --2- 172.21.15.143:0/2773765897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2d00d1740 0x7fd2d00b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd2d6b66640 1 -- 172.21.15.143:0/2773765897 >> v1:172.21.15.163:6789/0 conn(0x7fd2d00d0680 legacy=0x7fd2d015aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7fd2d6b66640 1 -- 172.21.15.143:0/2773765897 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d0073ef0 con 0x7fd2d00b4c30 2024-05-08T10:23:57.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fd2d6365640 1 --2- 172.21.15.143:0/2773765897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2d00d1740 0x7fd2d00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:57.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fd2d6b66640 1 --2- 172.21.15.143:0/2773765897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d00b4c30 0x7fd2d00b50a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e50 tx=0x7fd2c802a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c9ba43a0a07d7d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f2f3d39c640 1 -- 172.21.15.143:0/3133296061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f38070bb0 msgr2=0x7f2f38160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f2f3d39c640 1 --2- 172.21.15.143:0/3133296061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f38070bb0 0x7f2f38160e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f2f3d39c640 1 -- 172.21.15.143:0/3133296061 >> v1:172.21.15.143:6789/0 conn(0x7f2f38161340 legacy=0x7f2f380b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f2f3d39c640 1 -- 172.21.15.143:0/3133296061 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3815da60 con 0x7f2f38140100 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f74e6d9d640 1 -- 172.21.15.143:0/372705238 learned_addr learned my addr 172.21.15.143:0/372705238 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 813965735 0 0) 0x7f74e0053280 con 0x7f74e0048100 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74d4003520 con 0x7f74e0048100 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3268851579 0 0) 0x7f74d4003520 con 0x7f74e0048100 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74e0050040 msgr2=0x7f74e00542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.405+0000 7f74e559a640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74e0050040 0x7f74e00542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 >> v1:172.21.15.143:6789/0 conn(0x7f74e0053e50 legacy=0x7f74e004f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e0006160 con 0x7f74e0048100 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f74d00016d0 con 0x7f74e0048100 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 >> v1:172.21.15.163:6789/0 conn(0x7f74e0048100 legacy=0x7f74e0006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d40039f0 0x7f74d4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74d4004800 0x7f74d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74d40052a0 0x7f74d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f74e00e7b90 con 0x7f74d40039f0 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f74d401d1b0 con 0x7f74d40052a0 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f74d401d3b0 con 0x7f74d4004800 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e659c640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d40039f0 0x7f74d4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f74e6d9d640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74d40052a0 0x7f74d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca997f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca40b4550 con 0x7f1ca415b480 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1c9bfff640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f1ca4072ef0 0x7f1ca406fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:53170/0 (socket says 172.21.15.143:53170) 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca37fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1ca40cefd0 0x7f1ca4165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca37fe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1ca40cefd0 0x7f1ca4165ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48410/0 (socket says 172.21.15.143:48410) 2024-05-08T10:23:57.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca37fe640 1 -- 172.21.15.143:0/3270577052 learned_addr learned my addr 172.21.15.143:0/3270577052 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca997f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca40b4830 con 0x7f1ca4072ef0 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca997f640 1 -- 172.21.15.143:0/3270577052 --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca40b4b10 con 0x7f1ca40cefd0 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca27fc640 1 -- 172.21.15.143:0/3270577052 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818045459 0 0) 0x7f1ca40b4830 con 0x7f1ca4072ef0 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca27fc640 1 -- 172.21.15.143:0/3270577052 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c90003520 con 0x7f1ca4072ef0 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fc706ffd640 1 --2- 172.21.15.143:0/3078616462 >> v2:172.21.15.163:3300/0 conn(0x7fc70003e840 0x7fc700053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fc7077fe640 1 -- 172.21.15.143:0/3078616462 >> v2:172.21.15.163:3300/0 conn(0x7fc70003e840 msgr2=0x7fc700053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fc7077fe640 1 --2- 172.21.15.143:0/3078616462 >> v2:172.21.15.163:3300/0 conn(0x7fc70003e840 0x7fc700053bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fc7077fe640 1 -- 172.21.15.143:0/3078616462 >> v2:172.21.15.143:3300/0 conn(0x7fc700054130 msgr2=0x7fc7000e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fc7077fe640 1 --2- 172.21.15.143:0/3078616462 >> v2:172.21.15.143:3300/0 conn(0x7fc700054130 0x7fc7000e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fc7077fe640 1 -- 172.21.15.143:0/3078616462 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc700058b30 con 0x7fc7000e30c0 2024-05-08T10:23:57.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fc706ffd640 1 --2- 172.21.15.143:0/3078616462 >> v2:172.21.15.163:3300/0 conn(0x7fc70003e840 0x7fc700053bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:57.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fd13259c640 1 --2- 172.21.15.143:0/397299329 >> v2:172.21.15.163:3300/0 conn(0x7fd13415b480 0x7fd1340727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fd2d5363640 1 -- 172.21.15.143:0/2773765897 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8036070 con 0x7fd2d00b4c30 2024-05-08T10:23:57.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7fd2d5363640 1 -- 172.21.15.143:0/2773765897 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c802ae50 con 0x7fd2d00b4c30 2024-05-08T10:23:57.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f7ac6e2a640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7ab80dfef0 0x7f7ab80085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f7ac6e2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab8056590 con 0x7f7ab80e02d0 2024-05-08T10:23:57.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f7ac6e2a640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab8056870 con 0x7f7ab80e42d0 2024-05-08T10:23:57.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f7ac6e2a640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7ab80094b0 con 0x7f7ab80dfef0 2024-05-08T10:23:57.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fe292459640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2840e30c0 0x7fe284057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f7abffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7ab80e02d0 0x7f7ab80e3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39048/0 (socket says 172.21.15.143:39048) 2024-05-08T10:23:57.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f7abffff640 1 -- 172.21.15.143:0/2939497325 learned_addr learned my addr 172.21.15.143:0/2939497325 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:57.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fe292459640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe28403e840 0x7fe284053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f7ac4bc6640 1 --2- 172.21.15.143:0/2939497325 >> v2:172.21.15.163:3300/0 conn(0x7f7ab80dfef0 0x7f7ab80085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.407 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.406+0000 7f1ca37fe640 1 -- 172.21.15.143:0/3270577052 >> v1:172.21.15.163:6789/0 conn(0x7f1ca4072ef0 legacy=0x7f1ca406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f1ca37fe640 1 -- 172.21.15.143:0/3270577052 >> v1:172.21.15.143:6789/0 conn(0x7f1ca415b480 legacy=0x7f1ca40727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f1ca37fe640 1 -- 172.21.15.143:0/3270577052 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca40b4df0 con 0x7f1ca40cefd0 2024-05-08T10:23:57.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fe292459640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2840582d0 con 0x7fe284054130 2024-05-08T10:23:57.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd2d5363640 1 -- 172.21.15.143:0/2773765897 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8031800 con 0x7fd2d00b4c30 2024-05-08T10:23:57.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fe292459640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe284058570 con 0x7fe28403e840 2024-05-08T10:23:57.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fe28bfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2840e30c0 0x7fe284057d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fe292459640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe284058850 con 0x7fe2840e30c0 2024-05-08T10:23:57.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fe28bfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2840e30c0 0x7fe284057d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59028/0 (socket says 172.21.15.143:59028) 2024-05-08T10:23:57.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fe28bfff640 1 -- 172.21.15.143:0/3132932500 learned_addr learned my addr 172.21.15.143:0/3132932500 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fe28b7fe640 1 --2- 172.21.15.143:0/3132932500 >> v2:172.21.15.163:3300/0 conn(0x7fe28403e840 0x7fe284053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd2d7367640 1 -- 172.21.15.143:0/2773765897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d00b4c30 msgr2=0x7fd2d00b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd2d7367640 1 --2- 172.21.15.143:0/2773765897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d00b4c30 0x7fd2d00b50a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e50 tx=0x7fd2c802a630 comp rx=0 tx=0).stop 2024-05-08T10:23:57.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f74e6d9d640 1 -- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74d4004800 msgr2=0x7f74d4004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T10:23:57.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f74e6d9d640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74d4004800 0x7f74d4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f74e6d9d640 1 -- 172.21.15.143:0/372705238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d40039f0 msgr2=0x7f74d4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fc7077fe640 1 --2- 172.21.15.143:0/3078616462 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7000e30c0 0x7fc700057d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc700059f80 tx=0x7fc6fc02a280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9865db4a2ce24f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f74e6d9d640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d40039f0 0x7f74d4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7f74e6d9d640 1 -- 172.21.15.143:0/372705238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e0006160 con 0x7f74d40052a0 2024-05-08T10:23:57.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd13159a640 1 -- 172.21.15.143:0/397299329 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091243548 0 0) 0x7fd1340b4550 con 0x7fd13406fcb0 2024-05-08T10:23:57.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd13159a640 1 -- 172.21.15.143:0/397299329 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd11c003520 con 0x7fd13406fcb0 2024-05-08T10:23:57.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd131d9b640 1 -- 172.21.15.143:0/397299329 >> v2:172.21.15.163:3300/0 conn(0x7fd13415b480 msgr2=0x7fd1340727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd131d9b640 1 --2- 172.21.15.143:0/397299329 >> v2:172.21.15.163:3300/0 conn(0x7fd13415b480 0x7fd1340727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd131d9b640 1 -- 172.21.15.143:0/397299329 >> v1:172.21.15.143:6789/0 conn(0x7fd13406fcb0 legacy=0x7fd1340700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd131d9b640 1 -- 172.21.15.143:0/397299329 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1340b4df0 con 0x7fd1340cefd0 2024-05-08T10:23:57.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd2d7367640 1 -- 172.21.15.143:0/2773765897 shutdown_connections 2024-05-08T10:23:57.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd2d7367640 1 --2- 172.21.15.143:0/2773765897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d00b4c30 0x7fd2d00b50a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f7ac4bc6640 1 -- 172.21.15.143:0/2939497325 >> v1:172.21.15.163:6789/0 conn(0x7f7ab80e42d0 legacy=0x7f7ab8006ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f7ac4bc6640 1 -- 172.21.15.143:0/2939497325 >> v1:172.21.15.143:6789/0 conn(0x7f7ab80e02d0 legacy=0x7f7ab80e3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f7ac4bc6640 1 -- 172.21.15.143:0/2939497325 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab8008e60 con 0x7f7ab80dfef0 2024-05-08T10:23:57.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd2d7367640 1 --2- 172.21.15.143:0/2773765897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2d00d1740 0x7fd2d00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fd2d7367640 1 -- 172.21.15.143:0/2773765897 >> 172.21.15.143:0/2773765897 conn(0x7fd2d00d0c20 msgr2=0x7fd2d00d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7fe28bfff640 1 -- 172.21.15.143:0/3132932500 >> v2:172.21.15.163:3300/0 conn(0x7fe28403e840 msgr2=0x7fe284053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7fe28bfff640 1 --2- 172.21.15.143:0/3132932500 >> v2:172.21.15.163:3300/0 conn(0x7fe28403e840 0x7fe284053bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7fd2d7367640 1 -- 172.21.15.143:0/2773765897 shutdown_connections 2024-05-08T10:23:57.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7fd2d7367640 1 -- 172.21.15.143:0/2773765897 wait complete. 2024-05-08T10:23:57.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f2f3d39c640 1 --2- 172.21.15.143:0/3133296061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38140100 0x7f2f38070670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009e50 tx=0x7f2f3402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac38323289f117f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f74e659c640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74d40039f0 0x7f74d4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:57.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f1ca37fe640 1 --2- 172.21.15.143:0/3270577052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca40cefd0 0x7f1ca4165ee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009bd0 tx=0x7f1c9c02bc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78c33e67d161062e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fc7067fc640 1 -- 172.21.15.143:0/3078616462 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc037070 con 0x7fc7000e30c0 2024-05-08T10:23:57.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fc7067fc640 1 -- 172.21.15.143:0/3078616462 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc032440 con 0x7fc7000e30c0 2024-05-08T10:23:57.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.407+0000 7fc7067fc640 1 -- 172.21.15.143:0/3078616462 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc032810 con 0x7fc7000e30c0 2024-05-08T10:23:57.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7fe28bfff640 1 -- 172.21.15.143:0/3132932500 >> v1:172.21.15.163:6789/0 conn(0x7fe284054130 legacy=0x7fe2840e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7fe28affd640 1 -- 172.21.15.143:0/3132932500 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3472533542 0 0) 0x7fe2840582d0 con 0x7fe284054130 2024-05-08T10:23:57.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7fe28bfff640 1 -- 172.21.15.143:0/3132932500 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe284058b30 con 0x7fe2840e30c0 2024-05-08T10:23:57.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f74e6d9d640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74d40052a0 0x7f74d400b9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74e802e0e0 tx=0x7f74d4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f700b134c0e7fa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f2f2ffff640 1 -- 172.21.15.143:0/3133296061 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34036070 con 0x7f2f38140100 2024-05-08T10:23:57.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f2f2ffff640 1 -- 172.21.15.143:0/3133296061 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f34031600 con 0x7f2f38140100 2024-05-08T10:23:57.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80ad070 con 0x7f74d40052a0 2024-05-08T10:23:57.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e80a7840 con 0x7f74d40052a0 2024-05-08T10:23:57.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f74e559a640 1 -- 172.21.15.143:0/372705238 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8051630 con 0x7f74d40052a0 2024-05-08T10:23:57.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3078616462 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7000e30c0 msgr2=0x7fc700057d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7f2f2ffff640 1 -- 172.21.15.143:0/3133296061 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34036070 con 0x7f2f38140100 2024-05-08T10:23:57.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.408+0000 7fc70ccc2640 1 --2- 172.21.15.143:0/3078616462 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7000e30c0 0x7fc700057d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc700059f80 tx=0x7fc6fc02a280 comp rx=0 tx=0).stop 2024-05-08T10:23:57.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fd131d9b640 1 --2- 172.21.15.143:0/397299329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 0x7fd134072d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd1340733f0 tx=0x7fd12802a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819a045d46c32a5d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3078616462 shutdown_connections 2024-05-08T10:23:57.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fc70ccc2640 1 --2- 172.21.15.143:0/3078616462 >> v2:172.21.15.143:3300/0 conn(0x7fc700054130 0x7fc7000e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fc70ccc2640 1 --2- 172.21.15.143:0/3078616462 >> v2:172.21.15.163:3300/0 conn(0x7fc70003e840 0x7fc700053bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fc70ccc2640 1 --2- 172.21.15.143:0/3078616462 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7000e30c0 0x7fc700057d90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3078616462 >> 172.21.15.143:0/3078616462 conn(0x7fc7000559e0 msgr2=0x7fc700055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f7ac4bc6640 1 --2- 172.21.15.143:0/2939497325 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ab80dfef0 0x7f7ab80085d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009720 tx=0x7f7aac029fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c1d95bae42ca99b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3078616462 shutdown_connections 2024-05-08T10:23:57.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fe28bfff640 1 --2- 172.21.15.143:0/3132932500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2840e30c0 0x7fe284057d90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe28c063f70 tx=0x7fe28c0a6e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69da0bbbad0a0b85 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f1ca27fc640 1 -- 172.21.15.143:0/3270577052 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c02c780 con 0x7f1ca40cefd0 2024-05-08T10:23:57.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f1ca27fc640 1 -- 172.21.15.143:0/3270577052 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c02c920 con 0x7f1ca40cefd0 2024-05-08T10:23:57.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f1ca27fc640 1 -- 172.21.15.143:0/3270577052 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c02ccf0 con 0x7f1ca40cefd0 2024-05-08T10:23:57.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3078616462 wait complete. 2024-05-08T10:23:57.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fd13159a640 1 -- 172.21.15.143:0/397299329 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128031780 con 0x7fd1340cefd0 2024-05-08T10:23:57.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f7abf7fe640 1 -- 172.21.15.143:0/2939497325 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac037070 con 0x7f7ab80dfef0 2024-05-08T10:23:57.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f7abf7fe640 1 -- 172.21.15.143:0/2939497325 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac02ad00 con 0x7f7ab80dfef0 2024-05-08T10:23:57.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f7abf7fe640 1 -- 172.21.15.143:0/2939497325 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac032660 con 0x7f7ab80dfef0 2024-05-08T10:23:57.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f2f3f600640 1 -- 172.21.15.143:0/3133296061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38140100 msgr2=0x7f2f38070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f74ecf90640 1 -- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74d40052a0 msgr2=0x7f74d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f74ecf90640 1 --2- 172.21.15.143:0/372705238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74d40052a0 0x7f74d400b9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74e802e0e0 tx=0x7f74d4005830 comp rx=0 tx=0).stop 2024-05-08T10:23:57.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f74e6d9d640 1 -- 172.21.15.143:0/372705238 reap_dead start 2024-05-08T10:23:57.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f2f3f600640 1 --2- 172.21.15.143:0/3133296061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38140100 0x7f2f38070670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009e50 tx=0x7f2f3402a5f0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f74ecf90640 1 -- 172.21.15.143:0/372705238 shutdown_connections 2024-05-08T10:23:57.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f74ecf90640 1 -- 172.21.15.143:0/372705238 >> 172.21.15.143:0/372705238 conn(0x7f74e0009fe0 msgr2=0x7f74e000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fd13159a640 1 -- 172.21.15.143:0/397299329 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd128037070 con 0x7fd1340cefd0 2024-05-08T10:23:57.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fd13159a640 1 -- 172.21.15.143:0/397299329 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128031b20 con 0x7fd1340cefd0 2024-05-08T10:23:57.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fd2d7367640 1 Processor -- start 2024-05-08T10:23:57.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f2f3f600640 1 -- 172.21.15.143:0/3133296061 shutdown_connections 2024-05-08T10:23:57.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f2f3f600640 1 --2- 172.21.15.143:0/3133296061 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f38070bb0 0x7f2f38160e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7f2f3f600640 1 --2- 172.21.15.143:0/3133296061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38140100 0x7f2f38070670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7f2f3f600640 1 -- 172.21.15.143:0/3133296061 >> 172.21.15.143:0/3133296061 conn(0x7f2f38072a60 msgr2=0x7f2f3806c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fe28affd640 1 -- 172.21.15.143:0/3132932500 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b4070 con 0x7fe2840e30c0 2024-05-08T10:23:57.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fe28affd640 1 -- 172.21.15.143:0/3132932500 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28c0a7c60 con 0x7fe2840e30c0 2024-05-08T10:23:57.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.409+0000 7fe28affd640 1 -- 172.21.15.143:0/3132932500 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0af640 con 0x7fe2840e30c0 2024-05-08T10:23:57.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fe292459640 1 -- 172.21.15.143:0/3132932500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2840e30c0 msgr2=0x7fe284057d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fe292459640 1 --2- 172.21.15.143:0/3132932500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2840e30c0 0x7fe284057d90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe28c063f70 tx=0x7fe28c0a6e10 comp rx=0 tx=0).stop 2024-05-08T10:23:57.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fe292459640 1 -- 172.21.15.143:0/3132932500 shutdown_connections 2024-05-08T10:23:57.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fe292459640 1 --2- 172.21.15.143:0/3132932500 >> v2:172.21.15.163:3300/0 conn(0x7fe28403e840 0x7fe284053bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fe292459640 1 --2- 172.21.15.143:0/3132932500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2840e30c0 0x7fe284057d90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/2939497325 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ab80dfef0 msgr2=0x7f7ab80085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7f7ac6e2a640 1 --2- 172.21.15.143:0/2939497325 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ab80dfef0 0x7f7ab80085d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009720 tx=0x7f7aac029fb0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fd138e28640 1 -- 172.21.15.143:0/397299329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 msgr2=0x7fd134072d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fd138e28640 1 --2- 172.21.15.143:0/397299329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 0x7fd134072d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd1340733f0 tx=0x7fd12802a910 comp rx=0 tx=0).stop 2024-05-08T10:23:57.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fe292459640 1 -- 172.21.15.143:0/3132932500 >> 172.21.15.143:0/3132932500 conn(0x7fe2840559e0 msgr2=0x7fe284055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/2939497325 shutdown_connections 2024-05-08T10:23:57.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f7ac6e2a640 1 --2- 172.21.15.143:0/2939497325 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ab80dfef0 0x7f7ab80085d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/2939497325 >> 172.21.15.143:0/2939497325 conn(0x7f7ab801ef40 msgr2=0x7f7ab8055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.410+0000 7fd2d7367640 1 -- start start 2024-05-08T10:23:57.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f2f3f600640 1 -- 172.21.15.143:0/3133296061 shutdown_connections 2024-05-08T10:23:57.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f2f3f600640 1 -- 172.21.15.143:0/3133296061 wait complete. 2024-05-08T10:23:57.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f1ca997f640 1 -- 172.21.15.143:0/3270577052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca40cefd0 msgr2=0x7f1ca4165ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f1ca997f640 1 --2- 172.21.15.143:0/3270577052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca40cefd0 0x7f1ca4165ee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009bd0 tx=0x7f1c9c02bc40 comp rx=0 tx=0).stop 2024-05-08T10:23:57.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fe292459640 1 -- 172.21.15.143:0/3132932500 shutdown_connections 2024-05-08T10:23:57.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd138e28640 1 -- 172.21.15.143:0/397299329 shutdown_connections 2024-05-08T10:23:57.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd138e28640 1 --2- 172.21.15.143:0/397299329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 0x7fd134072d20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd138e28640 1 --2- 172.21.15.143:0/397299329 >> v2:172.21.15.163:3300/0 conn(0x7fd13415b480 0x7fd1340727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd138e28640 1 -- 172.21.15.143:0/397299329 >> 172.21.15.143:0/397299329 conn(0x7fd1340682f0 msgr2=0x7fd13406c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/2939497325 shutdown_connections 2024-05-08T10:23:57.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/2939497325 wait complete. 2024-05-08T10:23:57.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f1ca997f640 1 -- 172.21.15.143:0/3270577052 shutdown_connections 2024-05-08T10:23:57.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f1ca997f640 1 --2- 172.21.15.143:0/3270577052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca40cefd0 0x7f1ca4165ee0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f1ca997f640 1 -- 172.21.15.143:0/3270577052 >> 172.21.15.143:0/3270577052 conn(0x7f1ca40682f0 msgr2=0x7f1ca406c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fc70ccc2640 1 Processor -- start 2024-05-08T10:23:57.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f74ecf90640 1 -- 172.21.15.143:0/372705238 shutdown_connections 2024-05-08T10:23:57.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7f74ecf90640 1 -- 172.21.15.143:0/372705238 wait complete. 2024-05-08T10:23:57.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fe292459640 1 -- 172.21.15.143:0/3132932500 wait complete. 2024-05-08T10:23:57.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd138e28640 1 -- 172.21.15.143:0/397299329 shutdown_connections 2024-05-08T10:23:57.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd138e28640 1 -- 172.21.15.143:0/397299329 wait complete. 2024-05-08T10:23:57.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd2d7367640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d00b4c30 0x7fd2d0154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd2d7367640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2d00d0680 0x7fd2d00b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd2d7367640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2d00d1740 0x7fd2d00b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd2d7367640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d006e9a0 con 0x7fd2d00d1740 2024-05-08T10:23:57.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd2d7367640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d006e820 con 0x7fd2d00b4c30 2024-05-08T10:23:57.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd2d7367640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d006eb20 con 0x7fd2d00d0680 2024-05-08T10:23:57.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd2d6b66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2d00d1740 0x7fd2d00b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd2d6b66640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2d00d1740 0x7fd2d00b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35966/0 (socket says 172.21.15.143:35966) 2024-05-08T10:23:57.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.411+0000 7fd2d6b66640 1 -- 172.21.15.143:0/539958512 learned_addr learned my addr 172.21.15.143:0/539958512 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7f74ecf90640 1 Processor -- start 2024-05-08T10:23:57.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fd2d6b66640 1 -- 172.21.15.143:0/539958512 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2d00d0680 msgr2=0x7fd2d00b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7fe292459640 1 Processor -- start 2024-05-08T10:23:57.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fd2d6b66640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd2d00d0680 0x7fd2d00b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7f7ac6e2a640 1 Processor -- start 2024-05-08T10:23:57.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fc70ccc2640 1 -- start start 2024-05-08T10:23:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fd2d6b66640 1 -- 172.21.15.143:0/539958512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d00b4c30 msgr2=0x7fd2d0154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fd2d6b66640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d00b4c30 0x7fd2d0154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fd2d6b66640 1 -- 172.21.15.143:0/539958512 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d014f3f0 con 0x7fd2d00d1740 2024-05-08T10:23:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7f2f3f600640 1 Processor -- start 2024-05-08T10:23:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fd2d6b66640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2d00d1740 0x7fd2d00b32b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2c802a670 tx=0x7fd2c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fd2c6ffd640 1 -- 172.21.15.143:0/539958512 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8036050 con 0x7fd2d00d1740 2024-05-08T10:23:57.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fd2c6ffd640 1 -- 172.21.15.143:0/539958512 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c8042070 con 0x7fd2d00d1740 2024-05-08T10:23:57.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.412+0000 7fd2c6ffd640 1 -- 172.21.15.143:0/539958512 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8004280 con 0x7fd2d00d1740 2024-05-08T10:23:57.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7fd2d7367640 1 -- 172.21.15.143:0/539958512 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d014f6d0 con 0x7fd2d00d1740 2024-05-08T10:23:57.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7fd2d7367640 1 -- 172.21.15.143:0/539958512 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d014fc90 con 0x7fd2d00d1740 2024-05-08T10:23:57.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7f7ac6e2a640 1 -- start start 2024-05-08T10:23:57.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7f2f3f600640 1 -- start start 2024-05-08T10:23:57.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7fc70ccc2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc70003e840 0x7fc700052e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc70003e840 0x7fc700052e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc70003e840 0x7fc700052e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35970/0 (socket says 172.21.15.143:35970) 2024-05-08T10:23:57.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc7077fe640 1 -- 172.21.15.143:0/3521015684 learned_addr learned my addr 172.21.15.143:0/3521015684 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc70ccc2640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc700054130 0x7fc7000509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7f74ecf90640 1 -- start start 2024-05-08T10:23:57.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fd2d7367640 1 -- 172.21.15.143:0/539958512 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2d006a3d0 con 0x7fd2d00d1740 2024-05-08T10:23:57.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fd138e28640 1 Processor -- start 2024-05-08T10:23:57.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fd138e28640 1 -- start start 2024-05-08T10:23:57.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f74ecf90640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74d40052a0 0x7f74e0047150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f74ecf90640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74e004e2d0 0x7f74e00e0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.413+0000 7fe292459640 1 -- start start 2024-05-08T10:23:57.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fe292459640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe28403e840 0x7fe284052680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fe292459640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe284054130 0x7fe28417e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fe292459640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2840e30c0 0x7fe28417ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fe292459640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840e34a0 con 0x7fe284054130 2024-05-08T10:23:57.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fe292459640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe28403bfc0 con 0x7fe2840e30c0 2024-05-08T10:23:57.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fe292459640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe2840078e0 con 0x7fe28403e840 2024-05-08T10:23:57.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f7ac6e2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab80dfef0 0x7f7ab80d4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f2f3f600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38070bb0 0x7f2f3813b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f74e659c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74d40052a0 0x7f74e0047150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f74e659c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74d40052a0 0x7f74e0047150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59056/0 (socket says 172.21.15.143:59056) 2024-05-08T10:23:57.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc70ccc2640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7000e30c0 0x7fc700039380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3521015684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc7000e34a0 con 0x7fc70003e840 2024-05-08T10:23:57.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3521015684 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc70003bfc0 con 0x7fc7000e30c0 2024-05-08T10:23:57.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3521015684 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc7000e7170 con 0x7fc700054130 2024-05-08T10:23:57.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f74ecf90640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74e004e750 0x7f74e00e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc706ffd640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc700054130 0x7fc7000509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc7077fe640 1 -- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc700054130 msgr2=0x7fc7000509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc7077fe640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc700054130 0x7fc7000509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc7077fe640 1 -- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7000e30c0 msgr2=0x7fc700039380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T10:23:57.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc7077fe640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7000e30c0 0x7fc700039380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7fc7077fe640 1 -- 172.21.15.143:0/3521015684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc700051120 con 0x7fc70003e840 2024-05-08T10:23:57.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f7ac6e2a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ab80e42d0 0x7f7ab8034860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f7ac4bc6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab80dfef0 0x7f7ab80d4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f2f3f600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f38140100 0x7f2f380b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f2f3f600640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f38161340 0x7f2f380b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f2f3f600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381404e0 con 0x7f2f38140100 2024-05-08T10:23:57.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f2f3f600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3815e020 con 0x7f2f38070bb0 2024-05-08T10:23:57.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe284054130 0x7fe28417e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fe28bfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe28403e840 0x7fe284052680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.414+0000 7f2f3f600640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2f38161780 con 0x7f2f38161340 2024-05-08T10:23:57.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac4bc6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab80dfef0 0x7f7ab80d4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35974/0 (socket says 172.21.15.143:35974) 2024-05-08T10:23:57.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fe2909f6640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2840e30c0 0x7fe28417ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac6e2a640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ab804bf20 0x7f7ab800bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe284054130 0x7fe28417e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35990/0 (socket says 172.21.15.143:35990) 2024-05-08T10:23:57.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fe2909f6640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2840e30c0 0x7fe28417ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48446/0 (socket says 172.21.15.143:48446) 2024-05-08T10:23:57.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f2f3d39c640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38070bb0 0x7f2f3813b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fe28b7fe640 1 -- 172.21.15.143:0/1741555494 learned_addr learned my addr 172.21.15.143:0/1741555494 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f2f3d39c640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38070bb0 0x7f2f3813b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48470/0 (socket says 172.21.15.143:48470) 2024-05-08T10:23:57.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f2f3d39c640 1 -- 172.21.15.143:0/1319947251 learned_addr learned my addr 172.21.15.143:0/1319947251 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fc7077fe640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc70003e840 0x7fc700052e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009960 tx=0x7fc6fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f2f3db9d640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f38161340 0x7f2f380b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac4bc6640 1 -- 172.21.15.143:0/3800163002 learned_addr learned my addr 172.21.15.143:0/3800163002 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7abffff640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ab80e42d0 0x7f7ab8034860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab8008b10 con 0x7f7ab80dfef0 2024-05-08T10:23:57.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab8056b50 con 0x7f7ab804bf20 2024-05-08T10:23:57.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab80e4910 con 0x7f7ab80e42d0 2024-05-08T10:23:57.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac53c7640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ab804bf20 0x7f7ab800bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f1ca997f640 1 -- 172.21.15.143:0/3270577052 shutdown_connections 2024-05-08T10:23:57.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f1ca997f640 1 -- 172.21.15.143:0/3270577052 wait complete. 2024-05-08T10:23:57.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fc6f3fff640 1 -- 172.21.15.143:0/3521015684 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc037050 con 0x7fc70003e840 2024-05-08T10:23:57.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f2f3d39c640 1 -- 172.21.15.143:0/1319947251 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f38161340 msgr2=0x7f2f380b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f2f3d39c640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2f38161340 0x7f2f380b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f2f3d39c640 1 -- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f38140100 msgr2=0x7f2f380b6ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T10:23:57.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f2f3d39c640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f38140100 0x7f2f380b6ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f2f3d39c640 1 -- 172.21.15.143:0/1319947251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f381e86e0 con 0x7f2f38070bb0 2024-05-08T10:23:57.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f74e5d9b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74e004e2d0 0x7f74e00e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f74e5d9b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74e004e2d0 0x7f74e00e0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48456/0 (socket says 172.21.15.143:48456) 2024-05-08T10:23:57.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fd138e28640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd13406fcb0 0x7fd13415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fd138e28640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 0x7fd134141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3521015684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7000c5e40 con 0x7fc70003e840 2024-05-08T10:23:57.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3521015684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc700051400 con 0x7fc70003e840 2024-05-08T10:23:57.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fc6f3fff640 1 -- 172.21.15.143:0/3521015684 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc038040 con 0x7fc70003e840 2024-05-08T10:23:57.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fc6f3fff640 1 -- 172.21.15.143:0/3521015684 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc030bd0 con 0x7fc70003e840 2024-05-08T10:23:57.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac4bc6640 1 -- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ab80e42d0 msgr2=0x7f7ab8034860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac4bc6640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7ab80e42d0 0x7f7ab8034860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac4bc6640 1 -- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ab804bf20 msgr2=0x7f7ab800bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac4bc6640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ab804bf20 0x7f7ab800bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7f7ac4bc6640 1 -- 172.21.15.143:0/3800163002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab8035190 con 0x7f7ab80dfef0 2024-05-08T10:23:57.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.415+0000 7fd138e28640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd13415b480 0x7fd1340b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f2f3d39c640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38070bb0 0x7f2f3813b950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f34034040 tx=0x7f2f34004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd131d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 0x7fd134141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f74ecf90640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f74e0006720 con 0x7f74e004e750 2024-05-08T10:23:57.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f74ecf90640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f74e0006a90 con 0x7f74e004e2d0 2024-05-08T10:23:57.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f74ecf90640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f74e0007630 con 0x7f74d40052a0 2024-05-08T10:23:57.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f74e659c640 1 -- 172.21.15.143:0/582523636 learned_addr learned my addr 172.21.15.143:0/582523636 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fe28bfff640 1 -- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2840e30c0 msgr2=0x7fe28417ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fe28bfff640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2840e30c0 0x7fe28417ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fe28bfff640 1 -- 172.21.15.143:0/1741555494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe284054130 msgr2=0x7fe28417e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fe28bfff640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe284054130 0x7fe28417e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fe28bfff640 1 -- 172.21.15.143:0/1741555494 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2840e7340 con 0x7fe28403e840 2024-05-08T10:23:57.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fe2909f6640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2840e30c0 0x7fe28417ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:57.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd13259c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd13406fcb0 0x7fd13415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd13259c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd13406fcb0 0x7fd13415cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59106/0 (socket says 172.21.15.143:59106) 2024-05-08T10:23:57.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd131d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 0x7fd134141c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36018/0 (socket says 172.21.15.143:36018) 2024-05-08T10:23:57.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd138e28640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd1340695d0 con 0x7fd1340cefd0 2024-05-08T10:23:57.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd138e28640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd134069450 con 0x7fd13415b480 2024-05-08T10:23:57.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd132d9d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd13415b480 0x7fd1340b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd132d9d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd13415b480 0x7fd1340b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48496/0 (socket says 172.21.15.143:48496) 2024-05-08T10:23:57.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd132d9d640 1 -- 172.21.15.143:0/23760720 learned_addr learned my addr 172.21.15.143:0/23760720 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd13406e8e0 con 0x7fd13406fcb0 2024-05-08T10:23:57.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f74e659c640 1 -- 172.21.15.143:0/582523636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74e004e2d0 msgr2=0x7f74e00e0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f74e659c640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74e004e2d0 0x7f74e00e0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f74e659c640 1 -- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74e004e750 msgr2=0x7f74e00e0bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T10:23:57.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f7ac4bc6640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab80dfef0 0x7f7ab80d4240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7aac02a5a0 tx=0x7f7aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fe28bfff640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe28403e840 0x7fe284052680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe28c06b270 tx=0x7fe28c06a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f2f2dffb640 1 -- 172.21.15.143:0/1319947251 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34041020 con 0x7f2f38070bb0 2024-05-08T10:23:57.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f2f2dffb640 1 -- 172.21.15.143:0/1319947251 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f34007990 con 0x7f2f38070bb0 2024-05-08T10:23:57.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd132d9d640 1 -- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd13406fcb0 msgr2=0x7fd13415cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd132d9d640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd13406fcb0 0x7fd13415cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd132d9d640 1 -- 172.21.15.143:0/23760720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 msgr2=0x7fd134141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd132d9d640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 0x7fd134141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7fd132d9d640 1 -- 172.21.15.143:0/23760720 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13415d1b0 con 0x7fd13415b480 2024-05-08T10:23:57.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd13259c640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd13406fcb0 0x7fd13415cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-08T10:23:57.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd2c6ffd640 1 -- 172.21.15.143:0/539958512 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd2c8004420 con 0x7fd2d00d1740 2024-05-08T10:23:57.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f74e6d9d640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74e004e750 0x7f74e00e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f74e5d9b640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74e004e2d0 0x7f74e00e0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-08T10:23:57.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f74e659c640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74e004e750 0x7f74e00e0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f74e659c640 1 -- 172.21.15.143:0/582523636 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e004d230 con 0x7f74d40052a0 2024-05-08T10:23:57.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fe288ff9640 1 -- 172.21.15.143:0/1741555494 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b4040 con 0x7fe28403e840 2024-05-08T10:23:57.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fe288ff9640 1 -- 172.21.15.143:0/1741555494 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28c0bf070 con 0x7fe28403e840 2024-05-08T10:23:57.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd131d9b640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1340cefd0 0x7fd134141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:57.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fe288ff9640 1 -- 172.21.15.143:0/1741555494 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0ba840 con 0x7fe28403e840 2024-05-08T10:23:57.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd132d9d640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd13415b480 0x7fd1340b3290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c790 tx=0x7fd12c00cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2840515e0 con 0x7fe28403e840 2024-05-08T10:23:57.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe284051ba0 con 0x7fe28403e840 2024-05-08T10:23:57.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f74e659c640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74d40052a0 0x7f74e0047150 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f74d000d8e0 tx=0x7f74d000dda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f1ca997f640 1 Processor -- start 2024-05-08T10:23:57.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.416+0000 7f2f2dffb640 1 -- 172.21.15.143:0/1319947251 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34036070 con 0x7f2f38070bb0 2024-05-08T10:23:57.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f1ca997f640 1 -- start start 2024-05-08T10:23:57.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f381e89c0 con 0x7f2f38070bb0 2024-05-08T10:23:57.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd2c6ffd640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd2b4076350 0x7fd2b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd2c6ffd640 1 -- 172.21.15.143:0/539958512 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd2c80b8e30 con 0x7fd2d00d1740 2024-05-08T10:23:57.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd2c6ffd640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7fd2b407e570 0x7fd2b4080990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd2c6ffd640 1 -- 172.21.15.143:0/539958512 --> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2c803ee50 con 0x7fd2b407e570 2024-05-08T10:23:57.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd2c6ffd640 1 -- 172.21.15.143:0/539958512 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd2c80b9310 con 0x7fd2d00d1740 2024-05-08T10:23:57.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f74deffd640 1 -- 172.21.15.143:0/582523636 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0005480 con 0x7f74d40052a0 2024-05-08T10:23:57.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e004d510 con 0x7f74d40052a0 2024-05-08T10:23:57.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e004dad0 con 0x7f74d40052a0 2024-05-08T10:23:57.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7f74deffd640 1 -- 172.21.15.143:0/582523636 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d0017070 con 0x7f74d40052a0 2024-05-08T10:23:57.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7f74deffd640 1 -- 172.21.15.143:0/582523636 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d000b8d0 con 0x7f74d40052a0 2024-05-08T10:23:57.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2840057e0 con 0x7fe28403e840 2024-05-08T10:23:57.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f381e8f80 con 0x7f2f38070bb0 2024-05-08T10:23:57.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7fd2d6365640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd2b4076350 0x7fd2b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd122ffd640 1 -- 172.21.15.143:0/23760720 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c003b70 con 0x7fd13415b480 2024-05-08T10:23:57.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7fd122ffd640 1 -- 172.21.15.143:0/23760720 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12c003d10 con 0x7fd13415b480 2024-05-08T10:23:57.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7fd122ffd640 1 -- 172.21.15.143:0/23760720 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00aa90 con 0x7fd13415b480 2024-05-08T10:23:57.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1341421c0 con 0x7fd13415b480 2024-05-08T10:23:57.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd13415beb0 con 0x7fd13415b480 2024-05-08T10:23:57.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f7abd7fa640 1 -- 172.21.15.143:0/3800163002 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac042020 con 0x7f7ab80dfef0 2024-05-08T10:23:57.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f7abd7fa640 1 -- 172.21.15.143:0/3800163002 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac03d670 con 0x7f7ab80dfef0 2024-05-08T10:23:57.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.417+0000 7f7abd7fa640 1 -- 172.21.15.143:0/3800163002 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac037040 con 0x7f7ab80dfef0 2024-05-08T10:23:57.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab8035470 con 0x7f7ab80dfef0 2024-05-08T10:23:57.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.418+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab81776b0 con 0x7f7ab80dfef0 2024-05-08T10:23:57.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.419+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74cc001030 con 0x7f74d40052a0 2024-05-08T10:23:57.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.419+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3521015684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc6e8001030 con 0x7fc70003e840 2024-05-08T10:23:57.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.419+0000 7fd2d5b64640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7fd2b407e570 0x7fd2b4080990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd1340b68f0 con 0x7fd13415b480 2024-05-08T10:23:57.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7fd2d5b64640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7fd2b407e570 0x7fd2b4080990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7fd2d6365640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd2b4076350 0x7fd2b4078810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0006fd0 tx=0x7fd2c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7f1ca997f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca4072ef0 0x7f1ca414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7f1ca997f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca40cefd0 0x7f1ca4154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7f1ca997f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ca415b480 0x7f1ca4155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7fe288ff9640 1 -- 172.21.15.143:0/1741555494 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe28c0a7ae0 con 0x7fe28403e840 2024-05-08T10:23:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7f1ca997f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca40695d0 con 0x7f1ca4072ef0 2024-05-08T10:23:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7f1ca997f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca4069450 con 0x7f1ca40cefd0 2024-05-08T10:23:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7f1ca997f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca40703c0 con 0x7f1ca415b480 2024-05-08T10:23:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fc6f3fff640 1 -- 172.21.15.143:0/3521015684 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc6fc03c440 con 0x7fc70003e840 2024-05-08T10:23:57.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7f74deffd640 1 -- 172.21.15.143:0/582523636 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f74d000ba70 con 0x7f74d40052a0 2024-05-08T10:23:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.420+0000 7f1ca2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca4072ef0 0x7f1ca414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f1ca2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca4072ef0 0x7f1ca414afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36028/0 (socket says 172.21.15.143:36028) 2024-05-08T10:23:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f1ca2ffd640 1 -- 172.21.15.143:0/1827303901 learned_addr learned my addr 172.21.15.143:0/1827303901 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f1c9bfff640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca40cefd0 0x7f1ca4154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fe288ff9640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe2700763a0 0x7fe270078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fe288ff9640 1 -- 172.21.15.143:0/1741555494 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe28c134a70 con 0x7fe28403e840 2024-05-08T10:23:57.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fe288ff9640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fe27007e620 0x7fe270080a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fe288ff9640 1 -- 172.21.15.143:0/1741555494 --> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2700810f0 con 0x7fe27007e620 2024-05-08T10:23:57.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fe288ff9640 1 -- 172.21.15.143:0/1741555494 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe28c1392a0 con 0x7fe28403e840 2024-05-08T10:23:57.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fd122ffd640 1 -- 172.21.15.143:0/23760720 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd12c00ac30 con 0x7fd13415b480 2024-05-08T10:23:57.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fd2c6ffd640 1 -- 172.21.15.143:0/539958512 <== osd.0 v2:172.21.15.143:6800/2747905564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2c803ee50 con 0x7fd2b407e570 2024-05-08T10:23:57.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fc6f3fff640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc6ec0762d0 0x7fc6ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.419+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f3806a550 con 0x7f2f38070bb0 2024-05-08T10:23:57.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f1ca2ffd640 1 -- 172.21.15.143:0/1827303901 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ca415b480 msgr2=0x7f1ca4155230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T10:23:57.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f1ca2ffd640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ca415b480 0x7f1ca4155230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f1ca2ffd640 1 -- 172.21.15.143:0/1827303901 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca40cefd0 msgr2=0x7f1ca4154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f1ca2ffd640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca40cefd0 0x7f1ca4154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f1ca2ffd640 1 -- 172.21.15.143:0/1827303901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca414edc0 con 0x7f1ca4072ef0 2024-05-08T10:23:57.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f74deffd640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f74c80763d0 0x7f74c8078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f74deffd640 1 -- 172.21.15.143:0/582523636 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f74d0098630 con 0x7f74d40052a0 2024-05-08T10:23:57.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f74deffd640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f74c807e5f0 0x7f74c8080a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f74deffd640 1 -- 172.21.15.143:0/582523636 --> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74c80810c0 con 0x7f74c807e5f0 2024-05-08T10:23:57.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7f74deffd640 1 -- 172.21.15.143:0/582523636 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f74d0098a20 con 0x7f74d40052a0 2024-05-08T10:23:57.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.421+0000 7fc6f3fff640 1 -- 172.21.15.143:0/3521015684 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc6fc0b80e0 con 0x7fc70003e840 2024-05-08T10:23:57.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7f74e6d9d640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f74c807e5f0 0x7f74c8080a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fc706ffd640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc6ec0762d0 0x7fc6ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fc6f3fff640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc6ec07e470 0x7fc6ec080890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fc6f3fff640 1 -- 172.21.15.143:0/3521015684 --> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6fc032440 con 0x7fc6ec07e470 2024-05-08T10:23:57.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fc6f3fff640 1 -- 172.21.15.143:0/3521015684 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc6fc0bf050 con 0x7fc70003e840 2024-05-08T10:23:57.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7f74e5d9b640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f74c80763d0 0x7f74c8078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7f1ca2ffd640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca4072ef0 0x7f1ca414afe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c400 tx=0x7f1c9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fe2909f6640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fe27007e620 0x7fe270080a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fe28b7fe640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe2700763a0 0x7fe270078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fd122ffd640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd1140763d0 0x7fd114078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fc707fff640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc6ec07e470 0x7fc6ec080890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7f1ca0ff9640 1 -- 172.21.15.143:0/1827303901 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94017070 con 0x7f1ca4072ef0 2024-05-08T10:23:57.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7f1ca0ff9640 1 -- 172.21.15.143:0/1827303901 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c940052f0 con 0x7f1ca4072ef0 2024-05-08T10:23:57.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7f1ca0ff9640 1 -- 172.21.15.143:0/1827303901 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94003830 con 0x7f1ca4072ef0 2024-05-08T10:23:57.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fd122ffd640 1 -- 172.21.15.143:0/23760720 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd12c0973b0 con 0x7fd13415b480 2024-05-08T10:23:57.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7f74e6d9d640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f74c807e5f0 0x7f74c8080a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fd13259c640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd1140763d0 0x7fd114078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fd122ffd640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fd11407e5f0 0x7fd114080a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fe2909f6640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fe27007e620 0x7fe270080a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7fc707fff640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc6ec07e470 0x7fc6ec080890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7f7abd7fa640 1 -- 172.21.15.143:0/3800163002 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7aac045020 con 0x7f7ab80dfef0 2024-05-08T10:23:57.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7f7abd7fa640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7aa40763a0 0x7f7aa4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7f7abd7fa640 1 -- 172.21.15.143:0/3800163002 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7aac0b7e90 con 0x7f7ab80dfef0 2024-05-08T10:23:57.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7f2f2dffb640 1 -- 172.21.15.143:0/1319947251 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f34044020 con 0x7f2f38070bb0 2024-05-08T10:23:57.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7f74e5d9b640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f74c80763d0 0x7f74c8078890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74e0036810 tx=0x7f74d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca414f0a0 con 0x7f1ca4072ef0 2024-05-08T10:23:57.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca414f660 con 0x7f1ca4072ef0 2024-05-08T10:23:57.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.422+0000 7fd122ffd640 1 -- 172.21.15.143:0/23760720 --> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd12c003d10 con 0x7fd11407e5f0 2024-05-08T10:23:57.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7fd122ffd640 1 -- 172.21.15.143:0/23760720 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd12c09e050 con 0x7fd13415b480 2024-05-08T10:23:57.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7f7ac6e2a640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f7ab80e02d0 0x7f7ab8007910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7f74deffd640 1 -- 172.21.15.143:0/582523636 <== osd.2 v2:172.21.15.143:6808/2912298193 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74c80810c0 con 0x7f74c807e5f0 2024-05-08T10:23:57.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f2f2dffb640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2f1c0763a0 0x7f2f1c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7fc6f3fff640 1 -- 172.21.15.143:0/3521015684 <== osd.4 v2:172.21.15.163:6808/4191344201 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6fc032440 con 0x7fc6ec07e470 2024-05-08T10:23:57.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7fc706ffd640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc6ec0762d0 0x7fc6ec078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7000d7ed0 tx=0x7fc6f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7fe288ff9640 1 -- 172.21.15.143:0/1741555494 <== osd.5 v2:172.21.15.163:6800/688232145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2700810f0 con 0x7fe27007e620 2024-05-08T10:23:57.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7fd131d9b640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fd11407e5f0 0x7fd114080a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7fd13259c640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd1140763d0 0x7fd114078890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd12400bd60 tx=0x7fd12400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f2f2dffb640 1 -- 172.21.15.143:0/1319947251 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2f340b8190 con 0x7f2f38070bb0 2024-05-08T10:23:57.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f2f3cb9b640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2f1c0763a0 0x7f2f1c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f2f2dffb640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f2f1c07e5c0 0x7f2f1c0809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f2f2dffb640 1 -- 172.21.15.143:0/1319947251 --> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f1c081090 con 0x7f2f1c07e5c0 2024-05-08T10:23:57.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f2f2dffb640 1 -- 172.21.15.143:0/1319947251 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2f340bf050 con 0x7f2f38070bb0 2024-05-08T10:23:57.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f2f3db9d640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f2f1c07e5c0 0x7f2f1c0809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.423+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 --> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ab80057e0 con 0x7f7ab80e02d0 2024-05-08T10:23:57.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f7ac53c7640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f7ab80e02d0 0x7f7ab8007910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f7ac53c7640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f7ab80e02d0 0x7f7ab8007910 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.425+0000 7f2f3cb9b640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2f1c0763a0 0x7f2f1c078860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f380b4b00 tx=0x7f2f28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.424+0000 7f7abffff640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7aa40763a0 0x7f7aa4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.425+0000 7f2f3db9d640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f2f1c07e5c0 0x7f2f1c0809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.425+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ca406a550 con 0x7f1ca4072ef0 2024-05-08T10:23:57.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.425+0000 7f7abffff640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7aa40763a0 0x7f7aa4078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4007c90 tx=0x7f7ab4007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.425+0000 7fe28b7fe640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe2700763a0 0x7fe270078860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2840def20 tx=0x7fe280009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.425+0000 7f7abd7fa640 1 -- 172.21.15.143:0/3800163002 <== osd.7 v2:172.21.15.163:6816/4102156474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ab80057e0 con 0x7f7ab80e02d0 2024-05-08T10:23:57.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.426+0000 7fd131d9b640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fd11407e5f0 0x7fd114080a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.426+0000 7f2f2dffb640 1 -- 172.21.15.143:0/1319947251 <== osd.1 v2:172.21.15.143:6816/671471033 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f1c081090 con 0x7f2f1c07e5c0 2024-05-08T10:23:57.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.427+0000 7fd122ffd640 1 -- 172.21.15.143:0/23760720 <== osd.6 v2:172.21.15.163:6824/2263704478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd12c003d10 con 0x7fd11407e5f0 2024-05-08T10:23:57.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.427+0000 7f1ca0ff9640 1 -- 172.21.15.143:0/1827303901 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c9401a070 con 0x7f1ca4072ef0 2024-05-08T10:23:57.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.428+0000 7f1ca0ff9640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1c84076320 0x7f1c840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.428+0000 7f1ca0ff9640 1 -- 172.21.15.143:0/1827303901 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1c94097070 con 0x7f1ca4072ef0 2024-05-08T10:23:57.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.428+0000 7f1ca0ff9640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7f1c8407e540 0x7f1c84080960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.428+0000 7f1ca0ff9640 1 -- 172.21.15.143:0/1827303901 --> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c940054a0 con 0x7f1c8407e540 2024-05-08T10:23:57.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.428+0000 7f1ca0ff9640 1 -- 172.21.15.143:0/1827303901 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1c94097420 con 0x7f1ca4072ef0 2024-05-08T10:23:57.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.429+0000 7f1c9bfff640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1c84076320 0x7f1c840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.429+0000 7f1c9bfff640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1c84076320 0x7f1c840787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4153e00 tx=0x7f1c8c007b10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.430+0000 7f1ca37fe640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7f1c8407e540 0x7f1c84080960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.430+0000 7f1ca37fe640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7f1c8407e540 0x7f1c84080960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.431+0000 7f1ca0ff9640 1 -- 172.21.15.143:0/1827303901 <== osd.3 v2:172.21.15.143:6824/2042563744 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c940054a0 con 0x7f1c8407e540 2024-05-08T10:23:57.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.453+0000 7fc70ccc2640 1 -- 172.21.15.143:0/3521015684 --> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc6e8002dd0 con 0x7fc6ec07e470 2024-05-08T10:23:57.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.454+0000 7fc6f3fff640 1 -- 172.21.15.143:0/3521015684 <== osd.4 v2:172.21.15.163:6808/4191344201 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc6e8002dd0 con 0x7fc6ec07e470 2024-05-08T10:23:57.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.454+0000 7fc6f1ffb640 1 -- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc6ec07e470 msgr2=0x7fc6ec080890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fc6f1ffb640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc6ec07e470 0x7fc6ec080890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fd2d7367640 1 -- 172.21.15.143:0/539958512 --> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd2d0074520 con 0x7fd2b407e570 2024-05-08T10:23:57.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fc6f1ffb640 1 -- 172.21.15.143:0/3521015684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc6ec0762d0 msgr2=0x7fc6ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fc6f1ffb640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc6ec0762d0 0x7fc6ec078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7000d7ed0 tx=0x7fc6f4008040 comp rx=0 tx=0).stop 2024-05-08T10:23:57.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fc6f1ffb640 1 -- 172.21.15.143:0/3521015684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc70003e840 msgr2=0x7fc700052e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fc6f1ffb640 1 --2- 172.21.15.143:0/3521015684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc70003e840 0x7fc700052e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009960 tx=0x7fc6fc0046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fc707fff640 1 -- 172.21.15.143:0/3521015684 reap_dead start 2024-05-08T10:23:57.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fc6f1ffb640 1 -- 172.21.15.143:0/3521015684 shutdown_connections 2024-05-08T10:23:57.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fc6f1ffb640 1 -- 172.21.15.143:0/3521015684 >> 172.21.15.143:0/3521015684 conn(0x7fc7000559e0 msgr2=0x7fc70003aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 --> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74cc002dd0 con 0x7f74c807e5f0 2024-05-08T10:23:57.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.455+0000 7fd2c6ffd640 1 -- 172.21.15.143:0/539958512 <== osd.0 v2:172.21.15.143:6800/2747905564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd2d0074520 con 0x7fd2b407e570 2024-05-08T10:23:57.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.456+0000 7fc6f1ffb640 1 -- 172.21.15.143:0/3521015684 shutdown_connections 2024-05-08T10:23:57.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.456+0000 7fc6f1ffb640 1 -- 172.21.15.143:0/3521015684 wait complete. 2024-05-08T10:23:57.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.456+0000 7f74deffd640 1 -- 172.21.15.143:0/582523636 <== osd.2 v2:172.21.15.143:6808/2912298193 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f74cc002dd0 con 0x7f74c807e5f0 2024-05-08T10:23:57.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.456+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f74c807e5f0 msgr2=0x7f74c8080a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.456+0000 7f74ecf90640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f74c807e5f0 0x7f74c8080a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f74c80763d0 msgr2=0x7f74c8078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7f74ecf90640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f74c80763d0 0x7f74c8078890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74e0036810 tx=0x7f74d8009040 comp rx=0 tx=0).stop 2024-05-08T10:23:57.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74d40052a0 msgr2=0x7f74e0047150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7f74ecf90640 1 --2- 172.21.15.143:0/582523636 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f74d40052a0 0x7f74e0047150 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f74d000d8e0 tx=0x7f74d000dda0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7f74e6d9d640 1 -- 172.21.15.143:0/582523636 reap_dead start 2024-05-08T10:23:57.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.456+0000 7fd2c4ff9640 1 -- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7fd2b407e570 msgr2=0x7fd2b4080990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.456+0000 7fd2c4ff9640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7fd2b407e570 0x7fd2b4080990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7fd2c4ff9640 1 -- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd2b4076350 msgr2=0x7fd2b4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7fd2c4ff9640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd2b4076350 0x7fd2b4078810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0006fd0 tx=0x7fd2c0008040 comp rx=0 tx=0).stop 2024-05-08T10:23:57.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7fd2c4ff9640 1 -- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2d00d1740 msgr2=0x7fd2d00b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7fd2c4ff9640 1 --2- 172.21.15.143:0/539958512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2d00d1740 0x7fd2d00b32b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2c802a670 tx=0x7fd2c8004a40 comp rx=0 tx=0).stop 2024-05-08T10:23:57.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7fd2d6b66640 1 -- 172.21.15.143:0/539958512 reap_dead start 2024-05-08T10:23:57.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7fd2c4ff9640 1 -- 172.21.15.143:0/539958512 shutdown_connections 2024-05-08T10:23:57.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7fd2c4ff9640 1 -- 172.21.15.143:0/539958512 >> 172.21.15.143:0/539958512 conn(0x7fd2d00d0c20 msgr2=0x7fd2d015f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7fd2c4ff9640 1 -- 172.21.15.143:0/539958512 shutdown_connections 2024-05-08T10:23:57.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 shutdown_connections 2024-05-08T10:23:57.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 >> 172.21.15.143:0/582523636 conn(0x7f74e0009fe0 msgr2=0x7f74e0036840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.496 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7fd2c4ff9640 1 -- 172.21.15.143:0/539958512 wait complete. 2024-05-08T10:23:57.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 shutdown_connections 2024-05-08T10:23:57.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.457+0000 7f74ecf90640 1 -- 172.21.15.143:0/582523636 wait complete. 2024-05-08T10:23:57.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.458+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 --> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ab800f3c0 con 0x7f7ab80e02d0 2024-05-08T10:23:57.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.458+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 --> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe2840564b0 con 0x7fe27007e620 2024-05-08T10:23:57.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.458+0000 7f7abd7fa640 1 -- 172.21.15.143:0/3800163002 <== osd.7 v2:172.21.15.163:6816/4102156474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7ab800f3c0 con 0x7f7ab80e02d0 2024-05-08T10:23:57.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.458+0000 7fe288ff9640 1 -- 172.21.15.143:0/1741555494 <== osd.5 v2:172.21.15.163:6800/688232145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe2840564b0 con 0x7fe27007e620 2024-05-08T10:23:57.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.458+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 --> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f381e9410 con 0x7f2f1c07e5c0 2024-05-08T10:23:57.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f7ab80e02d0 msgr2=0x7f7ab8007910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f7ab80e02d0 0x7f7ab8007910 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7aa40763a0 msgr2=0x7f7aa4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7aa40763a0 0x7f7aa4078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4007c90 tx=0x7f7ab4007be0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab80dfef0 msgr2=0x7f7ab80d4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 --2- 172.21.15.143:0/3800163002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab80dfef0 0x7f7ab80d4240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7aac02a5a0 tx=0x7f7aac0046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac53c7640 1 -- 172.21.15.143:0/3800163002 reap_dead start 2024-05-08T10:23:57.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f2f2dffb640 1 -- 172.21.15.143:0/1319947251 <== osd.1 v2:172.21.15.143:6816/671471033 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2f381e9410 con 0x7f2f1c07e5c0 2024-05-08T10:23:57.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 shutdown_connections 2024-05-08T10:23:57.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 >> 172.21.15.143:0/3800163002 conn(0x7f7ab801ef40 msgr2=0x7f7ab80549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fe27007e620 msgr2=0x7fe270080a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7fe292459640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fe27007e620 0x7fe270080a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 shutdown_connections 2024-05-08T10:23:57.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.459+0000 7f7ac6e2a640 1 -- 172.21.15.143:0/3800163002 wait complete. 2024-05-08T10:23:57.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe2700763a0 msgr2=0x7fe270078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7fe292459640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe2700763a0 0x7fe270078860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2840def20 tx=0x7fe280009190 comp rx=0 tx=0).stop 2024-05-08T10:23:57.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe28403e840 msgr2=0x7fe284052680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7fe292459640 1 --2- 172.21.15.143:0/1741555494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe28403e840 0x7fe284052680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe28c06b270 tx=0x7fe28c06a1d0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7fe2909f6640 1 -- 172.21.15.143:0/1741555494 reap_dead start 2024-05-08T10:23:57.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f2f1c07e5c0 msgr2=0x7f2f1c0809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 shutdown_connections 2024-05-08T10:23:57.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 >> 172.21.15.143:0/1741555494 conn(0x7fe2840559e0 msgr2=0x7fe284057380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7f2f3f600640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f2f1c07e5c0 0x7f2f1c0809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 --> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd13406a550 con 0x7fd11407e5f0 2024-05-08T10:23:57.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7fd122ffd640 1 -- 172.21.15.143:0/23760720 <== osd.6 v2:172.21.15.163:6824/2263704478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd13406a550 con 0x7fd11407e5f0 2024-05-08T10:23:57.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.460+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 shutdown_connections 2024-05-08T10:23:57.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2f1c0763a0 msgr2=0x7f2f1c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f2f3f600640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2f1c0763a0 0x7f2f1c078860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f380b4b00 tx=0x7f2f28008040 comp rx=0 tx=0).stop 2024-05-08T10:23:57.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38070bb0 msgr2=0x7f2f3813b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f2f3f600640 1 --2- 172.21.15.143:0/1319947251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f38070bb0 0x7f2f3813b950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f34034040 tx=0x7f2f34004a40 comp rx=0 tx=0).stop 2024-05-08T10:23:57.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f2f3db9d640 1 -- 172.21.15.143:0/1319947251 reap_dead start 2024-05-08T10:23:57.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 shutdown_connections 2024-05-08T10:23:57.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 >> 172.21.15.143:0/1319947251 conn(0x7f2f38072a60 msgr2=0x7f2f3813f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7fe292459640 1 -- 172.21.15.143:0/1741555494 wait complete. 2024-05-08T10:23:57.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 shutdown_connections 2024-05-08T10:23:57.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fd11407e5f0 msgr2=0x7fd114080a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7fd138e28640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fd11407e5f0 0x7fd114080a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f2f3f600640 1 -- 172.21.15.143:0/1319947251 wait complete. 2024-05-08T10:23:57.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 --> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ca41576b0 con 0x7f1c8407e540 2024-05-08T10:23:57.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd1140763d0 msgr2=0x7fd114078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7fd138e28640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd1140763d0 0x7fd114078890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd12400bd60 tx=0x7fd12400d040 comp rx=0 tx=0).stop 2024-05-08T10:23:57.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd13415b480 msgr2=0x7fd1340b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7fd138e28640 1 --2- 172.21.15.143:0/23760720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd13415b480 0x7fd1340b3290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c790 tx=0x7fd12c00cc50 comp rx=0 tx=0).stop 2024-05-08T10:23:57.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.461+0000 7fd132d9d640 1 -- 172.21.15.143:0/23760720 reap_dead start 2024-05-08T10:23:57.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.462+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 shutdown_connections 2024-05-08T10:23:57.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.462+0000 7f1ca0ff9640 1 -- 172.21.15.143:0/1827303901 <== osd.3 v2:172.21.15.143:6824/2042563744 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1ca41576b0 con 0x7f1c8407e540 2024-05-08T10:23:57.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.462+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 >> 172.21.15.143:0/23760720 conn(0x7fd1340682f0 msgr2=0x7fd1340d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7f1c8407e540 msgr2=0x7f1c84080960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7f1ca997f640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7f1c8407e540 0x7f1c84080960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1c84076320 msgr2=0x7f1c840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7f1ca997f640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1c84076320 0x7f1c840787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4153e00 tx=0x7f1c8c007b10 comp rx=0 tx=0).stop 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca4072ef0 msgr2=0x7f1ca414afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7f1ca997f640 1 --2- 172.21.15.143:0/1827303901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1ca4072ef0 0x7f1ca414afe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c400 tx=0x7f1c9400c8c0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7f1ca37fe640 1 -- 172.21.15.143:0/1827303901 reap_dead start 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 shutdown_connections 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 >> 172.21.15.143:0/1827303901 conn(0x7f1ca40682f0 msgr2=0x7f1ca4155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 shutdown_connections 2024-05-08T10:23:57.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.463+0000 7fd138e28640 1 -- 172.21.15.143:0/23760720 wait complete. 2024-05-08T10:23:57.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.464+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 shutdown_connections 2024-05-08T10:23:57.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.464+0000 7f1ca997f640 1 -- 172.21.15.143:0/1827303901 wait complete. 2024-05-08T10:23:57.510 INFO:teuthology.orchestra.run.smithi143.stdout:55834574852 2024-05-08T10:23:57.511 INFO:teuthology.orchestra.run.smithi143.stdout:55834574852 2024-05-08T10:23:57.512 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T10:23:57.512 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T10:23:57.513 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2024-05-08T10:23:57.513 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2024-05-08T10:23:57.514 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T10:23:57.514 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T10:23:57.515 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2024-05-08T10:23:57.515 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T10:23:57.516 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2024-05-08T10:23:57.516 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T10:23:57.517 INFO:teuthology.orchestra.run.smithi143.stdout:55834574855 2024-05-08T10:23:57.517 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T10:23:57.518 INFO:teuthology.orchestra.run.smithi143.stdout:55834574855 2024-05-08T10:23:57.519 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T10:23:57.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.739+0000 7f33340f8640 1 Processor -- start 2024-05-08T10:23:57.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.739+0000 7f33340f8640 1 -- start start 2024-05-08T10:23:57.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.739+0000 7efda8e83640 1 Processor -- start 2024-05-08T10:23:57.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.739+0000 7efda8e83640 1 -- start start 2024-05-08T10:23:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.740+0000 7f33340f8640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f33240e3640 0x7f3324039b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.740+0000 7f33340f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f33240e7bc0 0x7f33240e7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.740+0000 7f33340f8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e7560 0x7f3324051310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.740+0000 7fe394567640 1 Processor -- start 2024-05-08T10:23:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.740+0000 7f33340f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f332403b860 con 0x7f33240e7bc0 2024-05-08T10:23:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.740+0000 7f33340f8640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f332403bb40 con 0x7f33240e3640 2024-05-08T10:23:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.740+0000 7fe394567640 1 -- start start 2024-05-08T10:23:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.740+0000 7f33340f8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f332403be20 con 0x7f33240e7560 2024-05-08T10:23:57.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7f3331e94640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f33240e3640 0x7f3324039b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7fb83b59e640 1 Processor -- start 2024-05-08T10:23:57.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7f3331e94640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f33240e3640 0x7f3324039b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48518/0 (socket says 172.21.15.143:48518) 2024-05-08T10:23:57.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7f3331e94640 1 -- 172.21.15.143:0/2281294622 learned_addr learned my addr 172.21.15.143:0/2281294622 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7f3332695640 1 --2- 172.21.15.143:0/2281294622 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e7560 0x7f3324051310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7f3331e94640 1 -- 172.21.15.143:0/2281294622 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e7560 msgr2=0x7f3324051310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7f3331e94640 1 --2- 172.21.15.143:0/2281294622 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e7560 0x7f3324051310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7efda8e83640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efd9c033f80 0x7efd9c0539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7efda8e83640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c052630 con 0x7efd9c038330 2024-05-08T10:23:57.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7efda8e83640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c052910 con 0x7efd9c053ef0 2024-05-08T10:23:57.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7efda8e83640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7efd9c053520 con 0x7efd9c033f80 2024-05-08T10:23:57.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7efda2d9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7efd9c038330 0x7efd9c04f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39050/0 (socket says 172.21.15.143:39050) 2024-05-08T10:23:57.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7efda2d9d640 1 -- 172.21.15.143:0/3618935132 learned_addr learned my addr 172.21.15.143:0/3618935132 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:57.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7f3331e94640 1 -- 172.21.15.143:0/2281294622 >> v2:172.21.15.143:3300/0 conn(0x7f33240e7bc0 msgr2=0x7f33240e7020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T10:23:57.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7f3331693640 1 --2- 172.21.15.143:0/2281294622 >> v2:172.21.15.143:3300/0 conn(0x7f33240e7bc0 0x7f33240e7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7f3331e94640 1 --2- 172.21.15.143:0/2281294622 >> v2:172.21.15.143:3300/0 conn(0x7f33240e7bc0 0x7f33240e7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7f3331e94640 1 -- 172.21.15.143:0/2281294622 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332403c100 con 0x7f33240e3640 2024-05-08T10:23:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe394567640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe3840eacf0 0x7fe38404fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe394567640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe38404ffc0 0x7fe384037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe394567640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe384053710 con 0x7fe384038100 2024-05-08T10:23:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe394567640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe384054320 con 0x7fe38404ffc0 2024-05-08T10:23:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe394567640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe3840539f0 con 0x7fe3840eacf0 2024-05-08T10:23:57.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7f3331693640 1 --2- 172.21.15.143:0/2281294622 >> v2:172.21.15.143:3300/0 conn(0x7f33240e7bc0 0x7f33240e7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:57.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe392303640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe3840eacf0 0x7fe38404fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe392303640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe3840eacf0 0x7fe38404fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48524/0 (socket says 172.21.15.143:48524) 2024-05-08T10:23:57.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe392303640 1 -- 172.21.15.143:0/3141804524 learned_addr learned my addr 172.21.15.143:0/3141804524 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7fb83b59e640 1 -- start start 2024-05-08T10:23:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe391b02640 1 --2- 172.21.15.143:0/3141804524 >> v2:172.21.15.143:3300/0 conn(0x7fe38404ffc0 0x7fe384037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe392303640 1 -- 172.21.15.143:0/3141804524 >> v2:172.21.15.143:3300/0 conn(0x7fe38404ffc0 msgr2=0x7fe384037bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f3332695640 1 --2- 172.21.15.143:0/2281294622 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e7560 0x7f3324051310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:57.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f9201904640 1 Processor -- start 2024-05-08T10:23:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f3331e94640 1 --2- 172.21.15.143:0/2281294622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33240e3640 0x7f3324039b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f33240043f0 tx=0x7f332802a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=630bc00224a8346b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f3330e92640 1 -- 172.21.15.143:0/2281294622 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328037070 con 0x7f33240e3640 2024-05-08T10:23:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f3330e92640 1 -- 172.21.15.143:0/2281294622 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3328032440 con 0x7f33240e3640 2024-05-08T10:23:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f3330e92640 1 -- 172.21.15.143:0/2281294622 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328032810 con 0x7f33240e3640 2024-05-08T10:23:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7efda259c640 1 --2- 172.21.15.143:0/3618935132 >> v2:172.21.15.143:3300/0 conn(0x7efd9c033f80 0x7efd9c0539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7efda259c640 1 -- 172.21.15.143:0/3618935132 >> v1:172.21.15.163:6789/0 conn(0x7efd9c053ef0 legacy=0x7efd9c037c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7efda259c640 1 -- 172.21.15.143:0/3618935132 >> v1:172.21.15.143:6789/0 conn(0x7efd9c038330 legacy=0x7efd9c04f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7efda259c640 1 -- 172.21.15.143:0/3618935132 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c052bf0 con 0x7efd9c033f80 2024-05-08T10:23:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe392303640 1 --2- 172.21.15.143:0/3141804524 >> v2:172.21.15.143:3300/0 conn(0x7fe38404ffc0 0x7fe384037bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe392303640 1 -- 172.21.15.143:0/3141804524 >> v1:172.21.15.163:6789/0 conn(0x7fe384038100 legacy=0x7fe384038570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T10:23:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7fe392303640 1 -- 172.21.15.143:0/3141804524 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe384053cd0 con 0x7fe3840eacf0 2024-05-08T10:23:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7fe391b02640 1 --2- 172.21.15.143:0/3141804524 >> v2:172.21.15.143:3300/0 conn(0x7fe38404ffc0 0x7fe384037bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7fe392303640 1 --2- 172.21.15.143:0/3141804524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3840eacf0 0x7fe38404fa80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe38c063f70 tx=0x7fe38c0a6d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9048bbaaed38df8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7f94bc346640 1 Processor -- start 2024-05-08T10:23:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.741+0000 7f94bc346640 1 -- start start 2024-05-08T10:23:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7f94bc346640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f94ac0e3350 0x7f94ac0061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7f94bc346640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f94ac03b160 0x7f94ac057c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7f94bc346640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ac006ad0 con 0x7f94ac03c0c0 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7f94bc346640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f94ac0577f0 con 0x7f94ac03b160 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.742+0000 7f94bc346640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f94ac006db0 con 0x7f94ac0e3350 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f94b98e1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f94ac03c0c0 0x7f94ac03aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39058/0 (socket says 172.21.15.143:39058) 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f94b98e1640 1 -- 172.21.15.143:0/4177875418 learned_addr learned my addr 172.21.15.143:0/4177875418 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f94ba8e3640 1 --2- 172.21.15.143:0/4177875418 >> v2:172.21.15.143:3300/0 conn(0x7f94ac03b160 0x7f94ac057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f94ba8e3640 1 -- 172.21.15.143:0/4177875418 >> v2:172.21.15.163:3300/0 conn(0x7f94ac0e3350 msgr2=0x7f94ac0061d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f94ba8e3640 1 --2- 172.21.15.143:0/4177875418 >> v2:172.21.15.163:3300/0 conn(0x7f94ac0e3350 0x7f94ac0061d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f94ba8e3640 1 -- 172.21.15.143:0/4177875418 >> v1:172.21.15.143:6789/0 conn(0x7f94ac03c0c0 legacy=0x7f94ac03aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f94ba8e3640 1 -- 172.21.15.143:0/4177875418 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ac007090 con 0x7f94ac03b160 2024-05-08T10:23:57.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7fb83b59e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 0x7fb83c163a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7fb83b59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb83c0b4cc0 0x7fb83c06c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7fb83b59e640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83c06c9b0 con 0x7fb83c06da50 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7fb83b59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb83c06cc90 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7fb83b59e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb83c06cf70 con 0x7fb83c164760 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7fb839d9b640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fb83c06da50 0x7fb83c0b45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:53222/0 (socket says 172.21.15.143:53222) 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7fb839d9b640 1 -- 172.21.15.143:0/2634963357 learned_addr learned my addr 172.21.15.143:0/2634963357 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7fb83a59c640 1 --2- 172.21.15.143:0/2634963357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 0x7fb83c163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7fb83ad9d640 1 --2- 172.21.15.143:0/2634963357 >> v2:172.21.15.143:3300/0 conn(0x7fb83c0b4cc0 0x7fb83c06c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7fb83a59c640 1 -- 172.21.15.143:0/2634963357 >> v2:172.21.15.143:3300/0 conn(0x7fb83c0b4cc0 msgr2=0x7fb83c06c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7fb83a59c640 1 --2- 172.21.15.143:0/2634963357 >> v2:172.21.15.143:3300/0 conn(0x7fb83c0b4cc0 0x7fb83c06c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7fb83a59c640 1 -- 172.21.15.143:0/2634963357 >> v1:172.21.15.163:6789/0 conn(0x7fb83c06da50 legacy=0x7fb83c0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7fb83a59c640 1 -- 172.21.15.143:0/2634963357 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c06d250 con 0x7fb83c164760 2024-05-08T10:23:57.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f910b59e640 1 Processor -- start 2024-05-08T10:23:57.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f910b59e640 1 -- start start 2024-05-08T10:23:57.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.743+0000 7f9201904640 1 -- start start 2024-05-08T10:23:57.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f9201904640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f91fc162ab0 0x7f91fc0d3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f9201904640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f91fc0d0680 0x7f91fc0d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f9201904640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91fc0d0bf0 con 0x7f91fc1626d0 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f9201904640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f91fc0b4b00 con 0x7f91fc162ab0 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f9201904640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f91fc0d0ed0 con 0x7f91fc0d0680 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f91faffd640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f91fc1626d0 0x7f91fc0d58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:53228/0 (socket says 172.21.15.143:53228) 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f91faffd640 1 -- 172.21.15.143:0/459459877 learned_addr learned my addr 172.21.15.143:0/459459877 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f33340f8640 1 -- 172.21.15.143:0/2281294622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33240e3640 msgr2=0x7f3324039b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7f33340f8640 1 --2- 172.21.15.143:0/2281294622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33240e3640 0x7f3324039b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f33240043f0 tx=0x7f332802a1d0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f33340f8640 1 -- 172.21.15.143:0/2281294622 shutdown_connections 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f33340f8640 1 --2- 172.21.15.143:0/2281294622 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e7560 0x7f3324051310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f33340f8640 1 --2- 172.21.15.143:0/2281294622 >> v2:172.21.15.143:3300/0 conn(0x7f33240e7bc0 0x7f33240e7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f33340f8640 1 --2- 172.21.15.143:0/2281294622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33240e3640 0x7f3324039b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f33340f8640 1 -- 172.21.15.143:0/2281294622 >> 172.21.15.143:0/2281294622 conn(0x7f3324056cc0 msgr2=0x7f33240570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7efda259c640 1 --2- 172.21.15.143:0/3618935132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 0x7efd9c0539b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd94009a00 tx=0x7efd9402a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2042c1377ebe2d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7fe391301640 1 -- 172.21.15.143:0/3141804524 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0b4070 con 0x7fe3840eacf0 2024-05-08T10:23:57.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7fe391301640 1 -- 172.21.15.143:0/3141804524 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c0a7bd0 con 0x7fe3840eacf0 2024-05-08T10:23:57.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.744+0000 7fe391301640 1 -- 172.21.15.143:0/3141804524 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0af640 con 0x7fe3840eacf0 2024-05-08T10:23:57.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7fa608be5640 1 Processor -- start 2024-05-08T10:23:57.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f94ba8e3640 1 --2- 172.21.15.143:0/4177875418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 0x7f94ac057c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f94ac03b670 tx=0x7f94b002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eafa1a85e7ea765 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7fa608be5640 1 -- start start 2024-05-08T10:23:57.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7fb83ad9d640 1 --2- 172.21.15.143:0/2634963357 >> v2:172.21.15.143:3300/0 conn(0x7fb83c0b4cc0 0x7fb83c06c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:57.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f91fb7fe640 1 --2- 172.21.15.143:0/459459877 >> v2:172.21.15.163:3300/0 conn(0x7f91fc0d0680 0x7f91fc0d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f91fa7fc640 1 --2- 172.21.15.143:0/459459877 >> v2:172.21.15.143:3300/0 conn(0x7f91fc162ab0 0x7f91fc0d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f33340f8640 1 -- 172.21.15.143:0/2281294622 shutdown_connections 2024-05-08T10:23:57.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f33340f8640 1 -- 172.21.15.143:0/2281294622 wait complete. 2024-05-08T10:23:57.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f94b90e0640 1 -- 172.21.15.143:0/4177875418 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0037070 con 0x7f94ac03b160 2024-05-08T10:23:57.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7f94b90e0640 1 -- 172.21.15.143:0/4177875418 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b0032440 con 0x7f94ac03b160 2024-05-08T10:23:57.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7efda159a640 1 -- 172.21.15.143:0/3618935132 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94037070 con 0x7efd9c033f80 2024-05-08T10:23:57.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7efda159a640 1 -- 172.21.15.143:0/3618935132 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9402ae10 con 0x7efd9c033f80 2024-05-08T10:23:57.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7efda159a640 1 -- 172.21.15.143:0/3618935132 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94032660 con 0x7efd9c033f80 2024-05-08T10:23:57.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7fe394567640 1 -- 172.21.15.143:0/3141804524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3840eacf0 msgr2=0x7fe38404fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7fe394567640 1 --2- 172.21.15.143:0/3141804524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3840eacf0 0x7fe38404fa80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe38c063f70 tx=0x7fe38c0a6d80 comp rx=0 tx=0).stop 2024-05-08T10:23:57.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.745+0000 7fb83a59c640 1 --2- 172.21.15.143:0/2634963357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 0x7fb83c163a70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0097a0 tx=0x7fb82c02a010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cedf7b9a28f2fb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fe394567640 1 -- 172.21.15.143:0/3141804524 shutdown_connections 2024-05-08T10:23:57.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fe394567640 1 --2- 172.21.15.143:0/3141804524 >> v2:172.21.15.143:3300/0 conn(0x7fe38404ffc0 0x7fe384037bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fe394567640 1 --2- 172.21.15.143:0/3141804524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3840eacf0 0x7fe38404fa80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fe394567640 1 -- 172.21.15.143:0/3141804524 >> 172.21.15.143:0/3141804524 conn(0x7fe384009fa0 msgr2=0x7fe38400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f910b59e640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f910c155da0 0x7f910c0cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f910b59e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c15f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f910b59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f910c15f750 0x7f910c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f94b90e0640 1 -- 172.21.15.143:0/4177875418 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0032810 con 0x7f94ac03b160 2024-05-08T10:23:57.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fb83959a640 1 -- 172.21.15.143:0/2634963357 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c037070 con 0x7fb83c164760 2024-05-08T10:23:57.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa608be5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa5fc050190 0x7fa5fc038070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa608be5640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa5fc00c090 0x7fa5fc007290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f910b59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f910c0b5420 con 0x7f910c15f750 2024-05-08T10:23:57.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f910b59e640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f910c0b5700 con 0x7f910c155da0 2024-05-08T10:23:57.746 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fb83959a640 1 -- 172.21.15.143:0/2634963357 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82c02aca0 con 0x7fb83c164760 2024-05-08T10:23:57.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa608be5640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5fc0077d0 con 0x7fa5fc0df210 2024-05-08T10:23:57.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f910b59e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f910c0b59e0 con 0x7f910c0cde10 2024-05-08T10:23:57.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fb83959a640 1 -- 172.21.15.143:0/2634963357 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82c032660 con 0x7fb83c164760 2024-05-08T10:23:57.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa608be5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc0544b0 con 0x7fa5fc050190 2024-05-08T10:23:57.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa608be5640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc0541d0 con 0x7fa5fc00c090 2024-05-08T10:23:57.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa6037fe640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fa5fc0df210 0x7fa5fc04fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:53236/0 (socket says 172.21.15.143:53236) 2024-05-08T10:23:57.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa6037fe640 1 -- 172.21.15.143:0/3110234177 learned_addr learned my addr 172.21.15.143:0/3110234177 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:57.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f94bc346640 1 -- 172.21.15.143:0/4177875418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 msgr2=0x7f94ac057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f94bc346640 1 --2- 172.21.15.143:0/4177875418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 0x7f94ac057c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f94ac03b670 tx=0x7f94b002a1c0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f9103fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c15f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f9103fff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c15f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59138/0 (socket says 172.21.15.143:59138) 2024-05-08T10:23:57.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fe394567640 1 -- 172.21.15.143:0/3141804524 shutdown_connections 2024-05-08T10:23:57.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f9103fff640 1 -- 172.21.15.143:0/883819562 learned_addr learned my addr 172.21.15.143:0/883819562 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881803885 0 0) 0x7fa5fc0077d0 con 0x7fa5fc0df210 2024-05-08T10:23:57.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f910ad9d640 1 --2- 172.21.15.143:0/883819562 >> v2:172.21.15.143:3300/0 conn(0x7f910c15f750 0x7f910c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5f4003520 con 0x7fa5fc0df210 2024-05-08T10:23:57.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa602ffd640 1 --2- 172.21.15.143:0/3110234177 >> v2:172.21.15.143:3300/0 conn(0x7fa5fc050190 0x7fa5fc038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7efda8e83640 1 -- 172.21.15.143:0/3618935132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 msgr2=0x7efd9c0539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7efda8e83640 1 --2- 172.21.15.143:0/3618935132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 0x7efd9c0539b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd94009a00 tx=0x7efd9402a390 comp rx=0 tx=0).stop 2024-05-08T10:23:57.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f94bc346640 1 -- 172.21.15.143:0/4177875418 shutdown_connections 2024-05-08T10:23:57.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f94bc346640 1 --2- 172.21.15.143:0/4177875418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 0x7f94ac057c80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f94bc346640 1 --2- 172.21.15.143:0/4177875418 >> v2:172.21.15.163:3300/0 conn(0x7f94ac0e3350 0x7f94ac0061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f94bc346640 1 -- 172.21.15.143:0/4177875418 >> 172.21.15.143:0/4177875418 conn(0x7f94ac058fd0 msgr2=0x7f94ac0593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4100073735 0 0) 0x7fa5f4003520 con 0x7fa5fc0df210 2024-05-08T10:23:57.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 >> v2:172.21.15.163:3300/0 conn(0x7fa5fc00c090 msgr2=0x7fa5fc007290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T10:23:57.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa6027fc640 1 --2- 172.21.15.143:0/3110234177 >> v2:172.21.15.163:3300/0 conn(0x7fa5fc00c090 0x7fa5fc007290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.751 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 >> v2:172.21.15.143:3300/0 conn(0x7fa5fc050190 msgr2=0x7fa5fc038070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fa6027fc640 1 --2- 172.21.15.143:0/3110234177 >> v2:172.21.15.143:3300/0 conn(0x7fa5fc050190 0x7fa5fc038070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc005f20 con 0x7fa5fc0df210 2024-05-08T10:23:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f94bc346640 1 -- 172.21.15.143:0/4177875418 shutdown_connections 2024-05-08T10:23:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7efda8e83640 1 -- 172.21.15.143:0/3618935132 shutdown_connections 2024-05-08T10:23:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7efda8e83640 1 --2- 172.21.15.143:0/3618935132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 0x7efd9c0539b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7efda8e83640 1 -- 172.21.15.143:0/3618935132 >> 172.21.15.143:0/3618935132 conn(0x7efd9c009fe0 msgr2=0x7efd9c00a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f9103fff640 1 -- 172.21.15.143:0/883819562 >> v2:172.21.15.163:3300/0 conn(0x7f910c155da0 msgr2=0x7f910c0cd8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T10:23:57.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f9103fff640 1 --2- 172.21.15.143:0/883819562 >> v2:172.21.15.163:3300/0 conn(0x7f910c155da0 0x7f910c0cd8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f9103fff640 1 -- 172.21.15.143:0/883819562 >> v2:172.21.15.143:3300/0 conn(0x7f910c15f750 msgr2=0x7f910c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.753 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f9103fff640 1 --2- 172.21.15.143:0/883819562 >> v2:172.21.15.143:3300/0 conn(0x7f910c15f750 0x7f910c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7fa604076870 con 0x7fa5fc0df210 2024-05-08T10:23:57.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 >> v1:172.21.15.163:6789/0 conn(0x7fa5fc0df210 legacy=0x7fa5fc04fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa6027fc640 1 --2- 172.21.15.143:0/3110234177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f40039b0 0x7fa5f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa6027fc640 1 --2- 172.21.15.143:0/3110234177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f4004310 0x7fa5f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f9103fff640 1 -- 172.21.15.143:0/883819562 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c0b5cc0 con 0x7f910c0cde10 2024-05-08T10:23:57.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7efda8e83640 1 -- 172.21.15.143:0/3618935132 shutdown_connections 2024-05-08T10:23:57.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa6027fc640 1 --2- 172.21.15.143:0/3110234177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004f40 0x7fa5f400ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0544b0 con 0x7fa5f4004f40 2024-05-08T10:23:57.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0541d0 con 0x7fa5f4004310 2024-05-08T10:23:57.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f4007b20 con 0x7fa5f40039b0 2024-05-08T10:23:57.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7efda8e83640 1 -- 172.21.15.143:0/3618935132 wait complete. 2024-05-08T10:23:57.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f910ad9d640 1 --2- 172.21.15.143:0/883819562 >> v2:172.21.15.143:3300/0 conn(0x7f910c15f750 0x7f910c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:57.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa602ffd640 1 --2- 172.21.15.143:0/3110234177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f4004310 0x7fa5f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7f91f9ffb640 1 -- 172.21.15.143:0/459459877 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345531381 0 0) 0x7f91fc0d0bf0 con 0x7f91fc1626d0 2024-05-08T10:23:57.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f91f9ffb640 1 -- 172.21.15.143:0/459459877 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91e4003520 con 0x7f91fc1626d0 2024-05-08T10:23:57.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f91fa7fc640 1 -- 172.21.15.143:0/459459877 >> v2:172.21.15.163:3300/0 conn(0x7f91fc0d0680 msgr2=0x7f91fc0d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f91fa7fc640 1 --2- 172.21.15.143:0/459459877 >> v2:172.21.15.163:3300/0 conn(0x7f91fc0d0680 0x7f91fc0d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f91fa7fc640 1 -- 172.21.15.143:0/459459877 >> v1:172.21.15.163:6789/0 conn(0x7f91fc1626d0 legacy=0x7f91fc0d58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.746+0000 7fe394567640 1 -- 172.21.15.143:0/3141804524 wait complete. 2024-05-08T10:23:57.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f94bc346640 1 -- 172.21.15.143:0/4177875418 wait complete. 2024-05-08T10:23:57.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f91fa7fc640 1 -- 172.21.15.143:0/459459877 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc0b4790 con 0x7f91fc162ab0 2024-05-08T10:23:57.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f33340f8640 1 Processor -- start 2024-05-08T10:23:57.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7f33340f8640 1 -- start start 2024-05-08T10:23:57.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7fe394567640 1 Processor -- start 2024-05-08T10:23:57.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa602ffd640 1 -- 172.21.15.143:0/3110234177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f40039b0 msgr2=0x7fa5f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:57.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa602ffd640 1 --2- 172.21.15.143:0/3110234177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5f40039b0 0x7fa5f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa602ffd640 1 -- 172.21.15.143:0/3110234177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004f40 msgr2=0x7fa5f400ffd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T10:23:57.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa602ffd640 1 --2- 172.21.15.143:0/3110234177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004f40 0x7fa5f400ffd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.747+0000 7fa602ffd640 1 -- 172.21.15.143:0/3110234177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f4003520 con 0x7fa5f4004310 2024-05-08T10:23:57.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7fe394567640 1 -- start start 2024-05-08T10:23:57.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7f9103fff640 1 --2- 172.21.15.143:0/883819562 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c15f210 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f910c073cc0 tx=0x7f90f402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b20b86a95d46d69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7fa603fff640 1 -- 172.21.15.143:0/3110234177 reap_dead start 2024-05-08T10:23:57.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7fb83b59e640 1 -- 172.21.15.143:0/2634963357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 msgr2=0x7fb83c163a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7fb83b59e640 1 --2- 172.21.15.143:0/2634963357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 0x7fb83c163a70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0097a0 tx=0x7fb82c02a010 comp rx=0 tx=0).stop 2024-05-08T10:23:57.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7f9109d9b640 1 -- 172.21.15.143:0/883819562 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4037070 con 0x7f910c0cde10 2024-05-08T10:23:57.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7f91fa7fc640 1 --2- 172.21.15.143:0/459459877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc162ab0 0x7f91fc0d3640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0d41c0 tx=0x7f91f002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0f5f28ee24d385 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7f9109d9b640 1 -- 172.21.15.143:0/883819562 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f4032440 con 0x7f910c0cde10 2024-05-08T10:23:57.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7f9109d9b640 1 -- 172.21.15.143:0/883819562 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4037070 con 0x7f910c0cde10 2024-05-08T10:23:57.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.748+0000 7fa602ffd640 1 --2- 172.21.15.143:0/3110234177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f4004310 0x7fa5f4004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800aa40 tx=0x7fa5f4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1ae999cf51725f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f91f9ffb640 1 -- 172.21.15.143:0/459459877 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0037070 con 0x7f91fc162ab0 2024-05-08T10:23:57.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f91f9ffb640 1 -- 172.21.15.143:0/459459877 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f0032440 con 0x7f91fc162ab0 2024-05-08T10:23:57.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f33340f8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e3640 0x7f33240cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f33340f8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33240e7560 0x7f33240e2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f33340f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33240e7bc0 0x7f33240d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f3331e94640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e3640 0x7f33240cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f3331e94640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e3640 0x7f33240cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59158/0 (socket says 172.21.15.143:59158) 2024-05-08T10:23:57.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f3331e94640 1 -- 172.21.15.143:0/739753583 learned_addr learned my addr 172.21.15.143:0/739753583 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f3332695640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33240e7bc0 0x7f33240d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f33340f8640 1 -- 172.21.15.143:0/739753583 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f332403ca80 con 0x7f33240e7bc0 2024-05-08T10:23:57.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f33340f8640 1 -- 172.21.15.143:0/739753583 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f332403c900 con 0x7f33240e7560 2024-05-08T10:23:57.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7efda8e83640 1 Processor -- start 2024-05-08T10:23:57.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7efda8e83640 1 -- start start 2024-05-08T10:23:57.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f94bc346640 1 Processor -- start 2024-05-08T10:23:57.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f94bc346640 1 -- start start 2024-05-08T10:23:57.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8038070 con 0x7fa5f4004310 2024-05-08T10:23:57.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f8033680 con 0x7fa5f4004310 2024-05-08T10:23:57.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f33340f8640 1 -- 172.21.15.143:0/739753583 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f332403b3f0 con 0x7f33240e3640 2024-05-08T10:23:57.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7fb83b59e640 1 -- 172.21.15.143:0/2634963357 shutdown_connections 2024-05-08T10:23:57.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7fb83b59e640 1 --2- 172.21.15.143:0/2634963357 >> v2:172.21.15.143:3300/0 conn(0x7fb83c0b4cc0 0x7fb83c06c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7fb83b59e640 1 --2- 172.21.15.143:0/2634963357 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 0x7fb83c163a70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7fb83b59e640 1 -- 172.21.15.143:0/2634963357 >> 172.21.15.143:0/2634963357 conn(0x7fb83c0b32b0 msgr2=0x7fb83c0b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f910b59e640 1 -- 172.21.15.143:0/883819562 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 msgr2=0x7f910c15f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f910b59e640 1 --2- 172.21.15.143:0/883819562 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c15f210 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f910c073cc0 tx=0x7f90f402a200 comp rx=0 tx=0).stop 2024-05-08T10:23:57.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7f3331693640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33240e7560 0x7f33240e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fb83b59e640 1 -- 172.21.15.143:0/2634963357 shutdown_connections 2024-05-08T10:23:57.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fa608be5640 1 -- 172.21.15.143:0/3110234177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f4004310 msgr2=0x7fa5f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fa6027fc640 1 -- 172.21.15.143:0/3110234177 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8038070 con 0x7fa5f4004310 2024-05-08T10:23:57.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fa608be5640 1 --2- 172.21.15.143:0/3110234177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f4004310 0x7fa5f4004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800aa40 tx=0x7fa5f4005830 comp rx=0 tx=0).stop 2024-05-08T10:23:57.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7fe394567640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe384038100 0x7fe38417d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7fe394567640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe38404ffc0 0x7fe384047010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.749+0000 7fe391b02640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe38404ffc0 0x7fe384047010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f9201904640 1 -- 172.21.15.143:0/459459877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc162ab0 msgr2=0x7f91fc0d3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f910b59e640 1 -- 172.21.15.143:0/883819562 shutdown_connections 2024-05-08T10:23:57.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f91f9ffb640 1 -- 172.21.15.143:0/459459877 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0037070 con 0x7f91fc162ab0 2024-05-08T10:23:57.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f910b59e640 1 --2- 172.21.15.143:0/883819562 >> v2:172.21.15.143:3300/0 conn(0x7f910c15f750 0x7f910c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f910b59e640 1 --2- 172.21.15.143:0/883819562 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c15f210 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f910b59e640 1 --2- 172.21.15.143:0/883819562 >> v2:172.21.15.163:3300/0 conn(0x7f910c155da0 0x7f910c0cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f9201904640 1 --2- 172.21.15.143:0/459459877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc162ab0 0x7f91fc0d3640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0d41c0 tx=0x7f91f002a1c0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f910b59e640 1 -- 172.21.15.143:0/883819562 >> 172.21.15.143:0/883819562 conn(0x7f910c073890 msgr2=0x7f910c06c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fe391b02640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe38404ffc0 0x7fe384047010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36146/0 (socket says 172.21.15.143:36146) 2024-05-08T10:23:57.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fe391b02640 1 -- 172.21.15.143:0/1202670070 learned_addr learned my addr 172.21.15.143:0/1202670070 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fe394567640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3840eacf0 0x7fe38404ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fe394567640 1 -- 172.21.15.143:0/1202670070 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe3840547b0 con 0x7fe38404ffc0 2024-05-08T10:23:57.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fe394567640 1 -- 172.21.15.143:0/1202670070 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe384038c80 con 0x7fe384038100 2024-05-08T10:23:57.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fe394567640 1 -- 172.21.15.143:0/1202670070 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe384054930 con 0x7fe3840eacf0 2024-05-08T10:23:57.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fe392303640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe384038100 0x7fe38417d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fb83b59e640 1 -- 172.21.15.143:0/2634963357 wait complete. 2024-05-08T10:23:57.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f910b59e640 1 -- 172.21.15.143:0/883819562 shutdown_connections 2024-05-08T10:23:57.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f9201904640 1 -- 172.21.15.143:0/459459877 shutdown_connections 2024-05-08T10:23:57.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f9201904640 1 --2- 172.21.15.143:0/459459877 >> v2:172.21.15.163:3300/0 conn(0x7f91fc0d0680 0x7f91fc0d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.771 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f9201904640 1 --2- 172.21.15.143:0/459459877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc162ab0 0x7f91fc0d3640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f9201904640 1 -- 172.21.15.143:0/459459877 >> 172.21.15.143:0/459459877 conn(0x7f91fc09e3a0 msgr2=0x7f91fc0d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7fe392303640 1 -- 172.21.15.143:0/1202670070 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3840eacf0 msgr2=0x7fe38404ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe392303640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3840eacf0 0x7fe38404ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe392303640 1 -- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe38404ffc0 msgr2=0x7fe384047010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe392303640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe38404ffc0 0x7fe384047010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f94bc346640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 0x7f94ac0de5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe392303640 1 -- 172.21.15.143:0/1202670070 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38404eac0 con 0x7fe384038100 2024-05-08T10:23:57.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda8e83640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 0x7efd9c04cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe391b02640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe38404ffc0 0x7fe384047010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:57.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f910b59e640 1 -- 172.21.15.143:0/883819562 wait complete. 2024-05-08T10:23:57.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94bc346640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94ac03c0c0 0x7f94ac050010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f9201904640 1 -- 172.21.15.143:0/459459877 shutdown_connections 2024-05-08T10:23:57.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94ba0e2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 0x7f94ac0de5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94ba0e2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 0x7f94ac0de5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36156/0 (socket says 172.21.15.143:36156) 2024-05-08T10:23:57.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe392303640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe384038100 0x7fe38417d2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0514f0 tx=0x7fe38c06a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94ba0e2640 1 -- 172.21.15.143:0/2237212304 learned_addr learned my addr 172.21.15.143:0/2237212304 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 0x7efd9c04cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94bc346640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94ac0e3350 0x7f94ac0e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 0x7efd9c04cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36166/0 (socket says 172.21.15.143:36166) 2024-05-08T10:23:57.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94bc346640 1 -- 172.21.15.143:0/2237212304 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac006890 con 0x7f94ac03b160 2024-05-08T10:23:57.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda259c640 1 -- 172.21.15.143:0/2471687399 learned_addr learned my addr 172.21.15.143:0/2471687399 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94bc346640 1 -- 172.21.15.143:0/2237212304 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac006710 con 0x7f94ac0e3350 2024-05-08T10:23:57.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda8e83640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9c038330 0x7efd9c0e5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.777 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94bc346640 1 -- 172.21.15.143:0/2237212304 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f94ac03e9b0 con 0x7f94ac03c0c0 2024-05-08T10:23:57.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe382ffd640 1 -- 172.21.15.143:0/1202670070 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0b4040 con 0x7fe384038100 2024-05-08T10:23:57.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda8e83640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd9c053ef0 0x7efd9c0e5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe394567640 1 -- 172.21.15.143:0/1202670070 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38404df40 con 0x7fe384038100 2024-05-08T10:23:57.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f3331e94640 1 -- 172.21.15.143:0/739753583 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33240e7560 msgr2=0x7f33240e2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f3331e94640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33240e7560 0x7f33240e2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f3331e94640 1 -- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33240e7bc0 msgr2=0x7f33240d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda1d9b640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9c038330 0x7efd9c0e5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f3331e94640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33240e7bc0 0x7f33240d4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f3331e94640 1 -- 172.21.15.143:0/739753583 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33240d01e0 con 0x7f33240e3640 2024-05-08T10:23:57.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.750+0000 7f3331e94640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e3640 0x7f33240cfca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f33280090b0 tx=0x7f33280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe394567640 1 -- 172.21.15.143:0/1202670070 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38404e500 con 0x7fe384038100 2024-05-08T10:23:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0546f0 con 0x7efd9c033f80 2024-05-08T10:23:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe382ffd640 1 -- 172.21.15.143:0/1202670070 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c0b8810 con 0x7fe384038100 2024-05-08T10:23:57.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7fe382ffd640 1 -- 172.21.15.143:0/1202670070 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0b8bc0 con 0x7fe384038100 2024-05-08T10:23:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0531b0 con 0x7efd9c038330 2024-05-08T10:23:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda2d9d640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd9c053ef0 0x7efd9c0e5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c054870 con 0x7efd9c053ef0 2024-05-08T10:23:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f9201904640 1 -- 172.21.15.143:0/459459877 wait complete. 2024-05-08T10:23:57.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7f33227fc640 1 -- 172.21.15.143:0/739753583 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328041020 con 0x7f33240e3640 2024-05-08T10:23:57.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7fa608be5640 1 -- 172.21.15.143:0/3110234177 shutdown_connections 2024-05-08T10:23:57.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7fa608be5640 1 --2- 172.21.15.143:0/3110234177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5f4004310 0x7fa5f4004800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7fa608be5640 1 -- 172.21.15.143:0/3110234177 >> 172.21.15.143:0/3110234177 conn(0x7fa5fc009fa0 msgr2=0x7fa5fc00a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:57.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7f33227fc640 1 -- 172.21.15.143:0/739753583 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3328030990 con 0x7f33240e3640 2024-05-08T10:23:57.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7fb83b59e640 1 Processor -- start 2024-05-08T10:23:57.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7fb83b59e640 1 -- start start 2024-05-08T10:23:57.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7efda1d9b640 1 -- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd9c053ef0 msgr2=0x7efd9c0e5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7efda1d9b640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd9c053ef0 0x7efd9c0e5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7efda1d9b640 1 -- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 msgr2=0x7efd9c04cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7efda1d9b640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 0x7efd9c04cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7efda1d9b640 1 -- 172.21.15.143:0/2471687399 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c048590 con 0x7efd9c038330 2024-05-08T10:23:57.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7efda1d9b640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9c038330 0x7efd9c0e5000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efda406b310 tx=0x7efda4069f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7efda259c640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 0x7efd9c04cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:57.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7fa608be5640 1 -- 172.21.15.143:0/3110234177 shutdown_connections 2024-05-08T10:23:57.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7fe394567640 1 -- 172.21.15.143:0/1202670070 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe374005290 con 0x7fe384038100 2024-05-08T10:23:57.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f9201904640 1 Processor -- start 2024-05-08T10:23:57.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f33227fc640 1 -- 172.21.15.143:0/739753583 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328037040 con 0x7f33240e3640 2024-05-08T10:23:57.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7efd92ffd640 1 -- 172.21.15.143:0/2471687399 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda40740b0 con 0x7efd9c038330 2024-05-08T10:23:57.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f910b59e640 1 Processor -- start 2024-05-08T10:23:57.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7efd92ffd640 1 -- 172.21.15.143:0/2471687399 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda4074270 con 0x7efd9c038330 2024-05-08T10:23:57.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94ba8e3640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94ac0e3350 0x7f94ac0e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.751+0000 7f94b98e1640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94ac03c0c0 0x7f94ac050010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7f94ba8e3640 1 -- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94ac03c0c0 msgr2=0x7f94ac050010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7f94ba8e3640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94ac03c0c0 0x7f94ac050010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.752+0000 7f94ba8e3640 1 -- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 msgr2=0x7f94ac0de5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f94ba8e3640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 0x7f94ac0de5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f94ba8e3640 1 -- 172.21.15.143:0/2237212304 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ac009fd0 con 0x7f94ac0e3350 2024-05-08T10:23:57.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f910b59e640 1 -- start start 2024-05-08T10:23:57.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f9201904640 1 -- start start 2024-05-08T10:23:57.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f94ba0e2640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 0x7f94ac0de5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:57.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f94ba8e3640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94ac0e3350 0x7f94ac0e53f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f94b0031000 tx=0x7f94b00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c048870 con 0x7efd9c038330 2024-05-08T10:23:57.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7fb83b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb83c06da50 0x7fb83c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.753+0000 7f94aaffd640 1 -- 172.21.15.143:0/2237212304 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0041070 con 0x7f94ac0e3350 2024-05-08T10:23:57.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fe382ffd640 1 -- 172.21.15.143:0/1202670070 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe38c0b7070 con 0x7fe384038100 2024-05-08T10:23:57.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f94bc346640 1 -- 172.21.15.143:0/2237212304 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ac00a2b0 con 0x7f94ac0e3350 2024-05-08T10:23:57.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fb83b59e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb83c0b4cc0 0x7fb83c162bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fb83a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb83c06da50 0x7fb83c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fb83a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb83c06da50 0x7fb83c0aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36178/0 (socket says 172.21.15.143:36178) 2024-05-08T10:23:57.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f94bc346640 1 -- 172.21.15.143:0/2237212304 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ac00a870 con 0x7f94ac0e3350 2024-05-08T10:23:57.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fb83a59c640 1 -- 172.21.15.143:0/1775712819 learned_addr learned my addr 172.21.15.143:0/1775712819 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.790 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fb83b59e640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 0x7fb83c15c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f33340f8640 1 -- 172.21.15.143:0/739753583 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3324007d80 con 0x7f33240e3640 2024-05-08T10:23:57.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f910b59e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c1f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f910b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f910c155da0 0x7f910c14b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f910b59e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f910c15f750 0x7f910c0d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f910b59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f910c068290 con 0x7f910c155da0 2024-05-08T10:23:57.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f910b59e640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f910c068110 con 0x7f910c15f750 2024-05-08T10:23:57.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f910b59e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f910c068410 con 0x7f910c0cde10 2024-05-08T10:23:57.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f9103fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f910c155da0 0x7f910c14b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f910a59c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c1f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f9103fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f910c155da0 0x7f910c14b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36180/0 (socket says 172.21.15.143:36180) 2024-05-08T10:23:57.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f9103fff640 1 -- 172.21.15.143:0/1327243444 learned_addr learned my addr 172.21.15.143:0/1327243444 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f910a59c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c1f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59206/0 (socket says 172.21.15.143:59206) 2024-05-08T10:23:57.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f33340f8640 1 -- 172.21.15.143:0/739753583 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3324008340 con 0x7f33240e3640 2024-05-08T10:23:57.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7efd92ffd640 1 -- 172.21.15.143:0/2471687399 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda4074660 con 0x7efd9c038330 2024-05-08T10:23:57.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c049350 con 0x7efd9c038330 2024-05-08T10:23:57.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fe382ffd640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe3700763a0 0x7fe370078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fb839d9b640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb83c0b4cc0 0x7fb83c162bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f9201904640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc0d0680 0x7f91fc200f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c06e7e0 con 0x7fb83c06da50 2024-05-08T10:23:57.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c073b70 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb83c06e960 con 0x7fb83c164760 2024-05-08T10:23:57.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fe382ffd640 1 -- 172.21.15.143:0/1202670070 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe38c134620 con 0x7fe384038100 2024-05-08T10:23:57.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f9201904640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91fc1626d0 0x7f91fc0ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7fa608be5640 1 -- 172.21.15.143:0/3110234177 wait complete. 2024-05-08T10:23:57.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f9201904640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91fc162ab0 0x7f91fc0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f91faffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc0d0680 0x7f91fc200f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f9201904640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc0b5110 con 0x7f91fc0d0680 2024-05-08T10:23:57.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f910ad9d640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f910c15f750 0x7f910c0d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f9201904640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc0b4f90 con 0x7f91fc162ab0 2024-05-08T10:23:57.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f9201904640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f91fc0b5290 con 0x7f91fc1626d0 2024-05-08T10:23:57.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f91faffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc0d0680 0x7f91fc200f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36192/0 (socket says 172.21.15.143:36192) 2024-05-08T10:23:57.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f91faffd640 1 -- 172.21.15.143:0/1327679042 learned_addr learned my addr 172.21.15.143:0/1327679042 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f91fb7fe640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91fc162ab0 0x7f91fc0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7fe391b02640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe3700763a0 0x7fe370078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f9103fff640 1 -- 172.21.15.143:0/1327243444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 msgr2=0x7f910c1f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f9103fff640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c1f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f9103fff640 1 -- 172.21.15.143:0/1327243444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f910c15f750 msgr2=0x7f910c0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f9103fff640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f910c15f750 0x7f910c0d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f9103fff640 1 -- 172.21.15.143:0/1327243444 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c1f4760 con 0x7f910c155da0 2024-05-08T10:23:57.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7fb839d9b640 1 -- 172.21.15.143:0/1775712819 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 msgr2=0x7fb83c15c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7fb839d9b640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 0x7fb83c15c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7fb839d9b640 1 -- 172.21.15.143:0/1775712819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb83c06da50 msgr2=0x7fb83c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7fb839d9b640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb83c06da50 0x7fb83c0aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7fb839d9b640 1 -- 172.21.15.143:0/1775712819 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c0afd50 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f94aaffd640 1 -- 172.21.15.143:0/2237212304 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b003c870 con 0x7f94ac0e3350 2024-05-08T10:23:57.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.754+0000 7f94aaffd640 1 -- 172.21.15.143:0/2237212304 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0037040 con 0x7f94ac0e3350 2024-05-08T10:23:57.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7f91fa7fc640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91fc1626d0 0x7f91fc0ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.755+0000 7fb839d9b640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb83c0b4cc0 0x7fb83c162bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb83400ca70 tx=0x7fb83400cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f91fb7fe640 1 -- 172.21.15.143:0/1327679042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91fc1626d0 msgr2=0x7f91fc0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f91fb7fe640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91fc1626d0 0x7f91fc0ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f91fb7fe640 1 -- 172.21.15.143:0/1327679042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc0d0680 msgr2=0x7f91fc200f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f94a8ff9640 1 -- 172.21.15.143:0/2237212304 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ac005380 con 0x7f94ac0e3350 2024-05-08T10:23:57.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f91fb7fe640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc0d0680 0x7f91fc200f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f91fb7fe640 1 -- 172.21.15.143:0/1327679042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc0b7df0 con 0x7f91fc162ab0 2024-05-08T10:23:57.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f33340f8640 1 -- 172.21.15.143:0/739753583 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33240057d0 con 0x7f33240e3640 2024-05-08T10:23:57.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f9103fff640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f910c155da0 0x7f910c14b0b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90f402a240 tx=0x7f90f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f91fb7fe640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91fc162ab0 0x7f91fc0ceb70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00efc0 tx=0x7f91ec00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f9102ffd640 1 -- 172.21.15.143:0/1327243444 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4037040 con 0x7f910c155da0 2024-05-08T10:23:57.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f9102ffd640 1 -- 172.21.15.143:0/1327243444 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f4042070 con 0x7f910c155da0 2024-05-08T10:23:57.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f9102ffd640 1 -- 172.21.15.143:0/1327243444 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4003e60 con 0x7f910c155da0 2024-05-08T10:23:57.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f33227fc640 1 -- 172.21.15.143:0/739753583 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3328044020 con 0x7f33240e3640 2024-05-08T10:23:57.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.756+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c1f4a40 con 0x7f910c155da0 2024-05-08T10:23:57.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.757+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c008a00 con 0x7efd9c038330 2024-05-08T10:23:57.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.757+0000 7fe391b02640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe3700763a0 0x7fe370078860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3840066d0 tx=0x7fe37c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.757+0000 7fa608be5640 1 Processor -- start 2024-05-08T10:23:57.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.757+0000 7f33227fc640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f33100763a0 0x7f3310078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.757+0000 7f33227fc640 1 -- 172.21.15.143:0/739753583 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f33280b7fb0 con 0x7f33240e3640 2024-05-08T10:23:57.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.757+0000 7f3331693640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f33100763a0 0x7f3310078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.757+0000 7fa608be5640 1 -- start start 2024-05-08T10:23:57.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.757+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c1f5000 con 0x7f910c155da0 2024-05-08T10:23:57.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.757+0000 7f3331693640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f33100763a0 0x7f3310078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33240e0ae0 tx=0x7f331c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910c06a3d0 con 0x7f910c155da0 2024-05-08T10:23:57.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7fa608be5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004310 0x7fa5fc04dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7fa608be5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5fc0e1e40 0x7fa5fc0d5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7fa608be5640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5fc0d86f0 0x7fa5fc0340f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7fa6037fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004310 0x7fa5fc04dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7f9102ffd640 1 -- 172.21.15.143:0/1327243444 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f90f403d450 con 0x7f910c155da0 2024-05-08T10:23:57.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7fa6037fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004310 0x7fa5fc04dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36198/0 (socket says 172.21.15.143:36198) 2024-05-08T10:23:57.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7fa6037fe640 1 -- 172.21.15.143:0/316266450 learned_addr learned my addr 172.21.15.143:0/316266450 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:57.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7fa608be5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc037900 con 0x7fa5f4004310 2024-05-08T10:23:57.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.758+0000 7fa602ffd640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5fc0e1e40 0x7fa5fc0d5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa603fff640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5fc0d86f0 0x7fa5fc0340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0064e0 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc037a80 con 0x7fa5fc0e1e40 2024-05-08T10:23:57.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7f9102ffd640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f90ec076320 0x7f90ec0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7f9102ffd640 1 -- 172.21.15.143:0/1327243444 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f90f40b7da0 con 0x7f910c155da0 2024-05-08T10:23:57.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7f910a59c640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f90ec076320 0x7f90ec0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa603fff640 1 -- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5fc0e1e40 msgr2=0x7fa5fc0d5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa603fff640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5fc0e1e40 0x7fa5fc0d5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa603fff640 1 -- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004310 msgr2=0x7fa5fc04dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:57.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa603fff640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004310 0x7fa5fc04dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:57.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa603fff640 1 -- 172.21.15.143:0/316266450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc04e4f0 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa602ffd640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5fc0e1e40 0x7fa5fc0d5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:57.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7fa6037fe640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004310 0x7fa5fc04dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:57.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.759+0000 7f910a59c640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f90ec076320 0x7f90ec0787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f910c0b3320 tx=0x7f90fc0090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.760+0000 7fe382ffd640 1 -- 172.21.15.143:0/1202670070 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe38c0fdff0 con 0x7fe384038100 2024-05-08T10:23:57.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.760+0000 7fa603fff640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5fc0d86f0 0x7fa5fc0340f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0524c0 tx=0x7fa5f0009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.760+0000 7fb82affd640 1 -- 172.21.15.143:0/1775712819 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834018070 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.760+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83c0aaa50 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.760+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb83c0b02f0 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.761+0000 7fb82affd640 1 -- 172.21.15.143:0/1775712819 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb83400a6a0 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.761+0000 7f91e3fff640 1 -- 172.21.15.143:0/1327679042 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec018020 con 0x7f91fc162ab0 2024-05-08T10:23:57.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.761+0000 7f91e3fff640 1 -- 172.21.15.143:0/1327679042 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ec014480 con 0x7f91fc162ab0 2024-05-08T10:23:57.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.761+0000 7f91e3fff640 1 -- 172.21.15.143:0/1327679042 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec014870 con 0x7f91fc162ab0 2024-05-08T10:23:57.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.761+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91fc0b80d0 con 0x7f91fc162ab0 2024-05-08T10:23:57.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.761+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91fc0b8690 con 0x7f91fc162ab0 2024-05-08T10:23:57.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.761+0000 7fb82affd640 1 -- 172.21.15.143:0/1775712819 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83400aa70 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.762+0000 7efd92ffd640 1 -- 172.21.15.143:0/2471687399 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efda4074800 con 0x7efd9c038330 2024-05-08T10:23:57.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.762+0000 7f94aaffd640 1 -- 172.21.15.143:0/2237212304 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f94b0044070 con 0x7f94ac0e3350 2024-05-08T10:23:57.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.762+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb820005290 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.762+0000 7f33227fc640 1 -- 172.21.15.143:0/739753583 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f332804b030 con 0x7f33240e3640 2024-05-08T10:23:57.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.762+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91fc069450 con 0x7f91fc162ab0 2024-05-08T10:23:57.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.762+0000 7efd92ffd640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efd840763a0 0x7efd84078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.762+0000 7f94aaffd640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94980763a0 0x7f9498078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.763+0000 7efd92ffd640 1 -- 172.21.15.143:0/2471687399 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efda4113fc0 con 0x7efd9c038330 2024-05-08T10:23:57.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.763+0000 7f94aaffd640 1 -- 172.21.15.143:0/2237212304 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f94b00b84b0 con 0x7f94ac0e3350 2024-05-08T10:23:57.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.763+0000 7efda259c640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efd840763a0 0x7efd84078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.763+0000 7f94ba0e2640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94980763a0 0x7f9498078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.763+0000 7efda259c640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efd840763a0 0x7efd84078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0e6630 tx=0x7efd9402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.763+0000 7f94ba0e2640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94980763a0 0x7f9498078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009dc0 tx=0x7f94a40090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.765+0000 7f9102ffd640 1 -- 172.21.15.143:0/1327243444 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f90f40816e0 con 0x7f910c155da0 2024-05-08T10:23:57.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.765+0000 7f94aaffd640 1 -- 172.21.15.143:0/2237212304 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f94b0081950 con 0x7f94ac0e3350 2024-05-08T10:23:57.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.770+0000 7efd92ffd640 1 -- 172.21.15.143:0/2471687399 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efda40a3080 con 0x7efd9c038330 2024-05-08T10:23:57.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.770+0000 7fa5effff640 1 -- 172.21.15.143:0/316266450 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0017070 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.770+0000 7fa5effff640 1 -- 172.21.15.143:0/316266450 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f0005310 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.770+0000 7fa5effff640 1 -- 172.21.15.143:0/316266450 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0003850 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.770+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc0d7c10 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.770+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc04e7d0 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.772+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5fc052bd0 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.772+0000 7fb82affd640 1 -- 172.21.15.143:0/1775712819 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb83401b070 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.772+0000 7fb82affd640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb81c0762d0 0x7fb81c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.772+0000 7fb82affd640 1 -- 172.21.15.143:0/1775712819 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb834097070 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.773+0000 7f91e3fff640 1 -- 172.21.15.143:0/1327679042 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f91ec005d10 con 0x7f91fc162ab0 2024-05-08T10:23:57.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.773+0000 7fb83a59c640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb81c0762d0 0x7fb81c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.773+0000 7f91e3fff640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f91e80762d0 0x7f91e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.774+0000 7f91e3fff640 1 -- 172.21.15.143:0/1327679042 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f91ec0989d0 con 0x7f91fc162ab0 2024-05-08T10:23:57.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.774+0000 7f91faffd640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f91e80762d0 0x7f91e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.774+0000 7fb83a59c640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb81c0762d0 0x7fb81c078790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb82c000c00 tx=0x7fb82c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.774+0000 7f91faffd640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f91e80762d0 0x7f91e8078790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91f4001220 tx=0x7f91f40071e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.775+0000 7fb82affd640 1 -- 172.21.15.143:0/1775712819 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb834022080 con 0x7fb83c0b4cc0 2024-05-08T10:23:57.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.779+0000 7f91e3fff640 1 -- 172.21.15.143:0/1327679042 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91ec022030 con 0x7f91fc162ab0 2024-05-08T10:23:57.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.784+0000 7fa5effff640 1 -- 172.21.15.143:0/316266450 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa5f00039f0 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.785+0000 7fa5effff640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5e8076500 0x7fa5e80789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:57.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.785+0000 7fa6037fe640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5e8076500 0x7fa5e80789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:57.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.786+0000 7fa6037fe640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5e8076500 0x7fa5e80789c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6040774b0 tx=0x7fa604076a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:57.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.786+0000 7fa5effff640 1 -- 172.21.15.143:0/316266450 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa5f00054c0 con 0x7fa5fc0d86f0 2024-05-08T10:23:57.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:57.787+0000 7fa5effff640 1 -- 172.21.15.143:0/316266450 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa5f005fe10 con 0x7fa5fc0d86f0 2024-05-08T10:23:58.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.183+0000 7f33340f8640 1 -- 172.21.15.143:0/739753583 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3324036540 con 0x7f33240e3640 2024-05-08T10:23:58.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.184+0000 7f33227fc640 1 -- 172.21.15.143:0/739753583 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33240d01e0 con 0x7f33240e3640 2024-05-08T10:23:58.169 INFO:teuthology.orchestra.run.smithi143.stdout:55834574851 2024-05-08T10:23:58.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.188+0000 7f330ffff640 1 -- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f33100763a0 msgr2=0x7f3310078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.188+0000 7f330ffff640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f33100763a0 0x7f3310078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33240e0ae0 tx=0x7f331c008040 comp rx=0 tx=0).stop 2024-05-08T10:23:58.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.188+0000 7f330ffff640 1 -- 172.21.15.143:0/739753583 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e3640 msgr2=0x7f33240cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.188+0000 7f330ffff640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e3640 0x7f33240cfca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f33280090b0 tx=0x7f33280046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.188+0000 7f330ffff640 1 -- 172.21.15.143:0/739753583 shutdown_connections 2024-05-08T10:23:58.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.189+0000 7f330ffff640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f33100763a0 0x7f3310078860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.189+0000 7f330ffff640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33240e7bc0 0x7f33240d4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.189+0000 7f330ffff640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f33240e7560 0x7f33240e2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.189+0000 7f330ffff640 1 --2- 172.21.15.143:0/739753583 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f33240e3640 0x7f33240cfca0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.189+0000 7f330ffff640 1 -- 172.21.15.143:0/739753583 >> 172.21.15.143:0/739753583 conn(0x7f3324056cc0 msgr2=0x7f3324055e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:58.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.190+0000 7f330ffff640 1 -- 172.21.15.143:0/739753583 shutdown_connections 2024-05-08T10:23:58.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.190+0000 7f330ffff640 1 -- 172.21.15.143:0/739753583 wait complete. 2024-05-08T10:23:58.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.193+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f910c1555c0 con 0x7f910c155da0 2024-05-08T10:23:58.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.194+0000 7f9102ffd640 1 -- 172.21.15.143:0/1327243444 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f90f4080fe0 con 0x7f910c155da0 2024-05-08T10:23:58.179 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2024-05-08T10:23:58.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.195+0000 7fe394567640 1 -- 172.21.15.143:0/1202670070 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe374005580 con 0x7fe384038100 2024-05-08T10:23:58.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.196+0000 7fe382ffd640 1 -- 172.21.15.143:0/1202670070 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe38c0fd8f0 con 0x7fe384038100 2024-05-08T10:23:58.181 INFO:teuthology.orchestra.run.smithi143.stdout:55834574852 2024-05-08T10:23:58.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.198+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f90ec076320 msgr2=0x7f90ec0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.198+0000 7f910b59e640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f90ec076320 0x7f90ec0787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f910c0b3320 tx=0x7f90fc0090e0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.198+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f910c155da0 msgr2=0x7f910c14b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.198+0000 7f910b59e640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f910c155da0 0x7f910c14b0b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90f402a240 tx=0x7f90f40046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 shutdown_connections 2024-05-08T10:23:58.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7f910b59e640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f910c15f750 0x7f910c0d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7f910b59e640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f90ec076320 0x7f90ec0787e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7f910b59e640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f910c155da0 0x7f910c14b0b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7f910b59e640 1 --2- 172.21.15.143:0/1327243444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f910c0cde10 0x7f910c1f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.185 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 >> 172.21.15.143:0/1327243444 conn(0x7f910c073890 msgr2=0x7f910c14ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:58.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7fe380ff9640 1 -- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe3700763a0 msgr2=0x7fe370078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7fe380ff9640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe3700763a0 0x7fe370078860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3840066d0 tx=0x7fe37c008040 comp rx=0 tx=0).stop 2024-05-08T10:23:58.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7fe380ff9640 1 -- 172.21.15.143:0/1202670070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe384038100 msgr2=0x7fe38417d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7fe380ff9640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe384038100 0x7fe38417d2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0514f0 tx=0x7fe38c06a1d0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.199+0000 7fe380ff9640 1 -- 172.21.15.143:0/1202670070 shutdown_connections 2024-05-08T10:23:58.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.200+0000 7fe380ff9640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3840eacf0 0x7fe38404ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.200+0000 7fe380ff9640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe3700763a0 0x7fe370078860 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.200+0000 7fe380ff9640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe38404ffc0 0x7fe384047010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.200+0000 7fe380ff9640 1 --2- 172.21.15.143:0/1202670070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe384038100 0x7fe38417d2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.200+0000 7fe380ff9640 1 -- 172.21.15.143:0/1202670070 >> 172.21.15.143:0/1202670070 conn(0x7fe384009fa0 msgr2=0x7fe384052c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:58.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.200+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 shutdown_connections 2024-05-08T10:23:58.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.200+0000 7f910b59e640 1 -- 172.21.15.143:0/1327243444 wait complete. 2024-05-08T10:23:58.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.200+0000 7fe380ff9640 1 -- 172.21.15.143:0/1202670070 shutdown_connections 2024-05-08T10:23:58.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.200+0000 7fe380ff9640 1 -- 172.21.15.143:0/1202670070 wait complete. 2024-05-08T10:23:58.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.203+0000 7f94a8ff9640 1 -- 172.21.15.143:0/2237212304 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f94ac0e2700 con 0x7f94ac0e3350 2024-05-08T10:23:58.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.204+0000 7f94aaffd640 1 -- 172.21.15.143:0/2237212304 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f94b0085c50 con 0x7f94ac0e3350 2024-05-08T10:23:58.189 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2024-05-08T10:23:58.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.205+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efd9c038de0 con 0x7efd9c038330 2024-05-08T10:23:58.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.206+0000 7efd92ffd640 1 -- 172.21.15.143:0/2471687399 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efda4090030 con 0x7efd9c038330 2024-05-08T10:23:58.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.206+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb820005850 con 0x7fb83c0b4cc0 2024-05-08T10:23:58.192 INFO:teuthology.orchestra.run.smithi143.stdout:55834574851 2024-05-08T10:23:58.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 -- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94980763a0 msgr2=0x7f9498078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94980763a0 0x7f9498078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009dc0 tx=0x7f94a40090e0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 -- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94ac0e3350 msgr2=0x7f94ac0e53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94ac0e3350 0x7f94ac0e53f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f94b0031000 tx=0x7f94b00046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 -- 172.21.15.143:0/2237212304 shutdown_connections 2024-05-08T10:23:58.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94ac0e3350 0x7f94ac0e53f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94ac03c0c0 0x7f94ac050010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94980763a0 0x7f9498078860 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 --2- 172.21.15.143:0/2237212304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94ac03b160 0x7f94ac0de5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 -- 172.21.15.143:0/2237212304 >> 172.21.15.143:0/2237212304 conn(0x7f94ac058fd0 msgr2=0x7f94ac03a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:58.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7fb82affd640 1 -- 172.21.15.143:0/1775712819 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb834060360 con 0x7fb83c0b4cc0 2024-05-08T10:23:58.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.207+0000 7f94a8ff9640 1 -- 172.21.15.143:0/2237212304 shutdown_connections 2024-05-08T10:23:58.195 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2024-05-08T10:23:58.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.209+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f91fc06e0f0 con 0x7f91fc162ab0 2024-05-08T10:23:58.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.209+0000 7f94a8ff9640 1 -- 172.21.15.143:0/2237212304 wait complete. 2024-05-08T10:23:58.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-05-08T10:23:58.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.209+0000 7f91e3fff640 1 -- 172.21.15.143:0/1327679042 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91ec010040 con 0x7f91fc162ab0 2024-05-08T10:23:58.197 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efd840763a0 msgr2=0x7efd84078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efd840763a0 0x7efd84078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0e6630 tx=0x7efd9402e000 comp rx=0 tx=0).stop 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9c038330 msgr2=0x7efd9c0e5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9c038330 0x7efd9c0e5000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efda406b310 tx=0x7efda4069f30 comp rx=0 tx=0).stop 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 shutdown_connections 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd9c053ef0 0x7efd9c0e5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9c038330 0x7efd9c0e5000 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efd840763a0 0x7efd84078860 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0e6630 tx=0x7efd9402e000 comp rx=0 tx=0).stop 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 --2- 172.21.15.143:0/2471687399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c033f80 0x7efd9c04cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.210+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 >> 172.21.15.143:0/2471687399 conn(0x7efd9c009fe0 msgr2=0x7efd9c04f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:58.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 shutdown_connections 2024-05-08T10:23:58.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7efda8e83640 1 -- 172.21.15.143:0/2471687399 wait complete. 2024-05-08T10:23:58.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb81c0762d0 msgr2=0x7fb81c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb81c0762d0 0x7fb81c078790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb82c000c00 tx=0x7fb82c02e000 comp rx=0 tx=0).stop 2024-05-08T10:23:58.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb83c0b4cc0 msgr2=0x7fb83c162bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb83c0b4cc0 0x7fb83c162bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb83400ca70 tx=0x7fb83400cf30 comp rx=0 tx=0).stop 2024-05-08T10:23:58.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 shutdown_connections 2024-05-08T10:23:58.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb83c164760 0x7fb83c15c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb83c0b4cc0 0x7fb83c162bc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb81c0762d0 0x7fb81c078790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 --2- 172.21.15.143:0/1775712819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb83c06da50 0x7fb83c0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 >> 172.21.15.143:0/1775712819 conn(0x7fb83c0b32b0 msgr2=0x7fb83c166eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:58.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 shutdown_connections 2024-05-08T10:23:58.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.211+0000 7fb83b59e640 1 -- 172.21.15.143:0/1775712819 wait complete. 2024-05-08T10:23:58.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.213+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f91e80762d0 msgr2=0x7f91e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.213+0000 7f9201904640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f91e80762d0 0x7f91e8078790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91f4001220 tx=0x7f91f40071e0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.213+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91fc162ab0 msgr2=0x7f91fc0ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.213+0000 7f9201904640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91fc162ab0 0x7f91fc0ceb70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00efc0 tx=0x7f91ec00c490 comp rx=0 tx=0).stop 2024-05-08T10:23:58.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.214+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 shutdown_connections 2024-05-08T10:23:58.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.214+0000 7f9201904640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91fc162ab0 0x7f91fc0ceb70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.214+0000 7f9201904640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f91fc1626d0 0x7f91fc0ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.214+0000 7f9201904640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f91e80762d0 0x7f91e8078790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.214+0000 7f9201904640 1 --2- 172.21.15.143:0/1327679042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91fc0d0680 0x7f91fc200f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.214+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 >> 172.21.15.143:0/1327679042 conn(0x7f91fc09e3a0 msgr2=0x7f91fc0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:58.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.214+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 shutdown_connections 2024-05-08T10:23:58.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.214+0000 7f9201904640 1 -- 172.21.15.143:0/1327679042 wait complete. 2024-05-08T10:23:58.204 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.218+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa5fc00ac00 con 0x7fa5fc0d86f0 2024-05-08T10:23:58.204 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.219+0000 7fa5effff640 1 -- 172.21.15.143:0/316266450 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa5f0064110 con 0x7fa5fc0d86f0 2024-05-08T10:23:58.204 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2024-05-08T10:23:58.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-05-08T10:23:58.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5e8076500 msgr2=0x7fa5e80789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5e8076500 0x7fa5e80789c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6040774b0 tx=0x7fa604076a90 comp rx=0 tx=0).stop 2024-05-08T10:23:58.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5fc0d86f0 msgr2=0x7fa5fc0340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:58.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5fc0d86f0 0x7fa5fc0340f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0524c0 tx=0x7fa5f0009800 comp rx=0 tx=0).stop 2024-05-08T10:23:58.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 shutdown_connections 2024-05-08T10:23:58.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5fc0d86f0 0x7fa5fc0340f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5fc0e1e40 0x7fa5fc0d5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5e8076500 0x7fa5e80789c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 --2- 172.21.15.143:0/316266450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f4004310 0x7fa5fc04dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:58.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 >> 172.21.15.143:0/316266450 conn(0x7fa5fc009fa0 msgr2=0x7fa5fc0dc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:58.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 shutdown_connections 2024-05-08T10:23:58.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:58.223+0000 7fa608be5640 1 -- 172.21.15.143:0/316266450 wait complete. 2024-05-08T10:23:58.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-05-08T10:23:58.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-05-08T10:23:58.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-05-08T10:23:58.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-05-08T10:23:58.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-05-08T10:23:58.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-05-08T10:23:59.198 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T10:23:59.208 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T10:23:59.213 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T10:23:59.218 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T10:23:59.221 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T10:23:59.221 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T10:23:59.222 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T10:23:59.223 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T10:23:59.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.378+0000 7fb753b46640 1 Processor -- start 2024-05-08T10:23:59.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.379+0000 7fb753b46640 1 -- start start 2024-05-08T10:23:59.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.380+0000 7fb753b46640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb7440e02c0 0x7fb7440e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.380+0000 7fb753b46640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb7440e40f0 0x7fb7440539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.380+0000 7fb753b46640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7440e4500 con 0x7fb7440dfee0 2024-05-08T10:23:59.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.380+0000 7fb753b46640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb7440094a0 con 0x7fb7440e02c0 2024-05-08T10:23:59.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.380+0000 7fb753b46640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb744056580 con 0x7fb7440e40f0 2024-05-08T10:23:59.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.381+0000 7fb7510e1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb7440e02c0 0x7fb7440e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.381+0000 7fb7510e1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb7440e02c0 0x7fb7440e3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36214/0 (socket says 172.21.15.143:36214) 2024-05-08T10:23:59.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.381+0000 7fb7510e1640 1 -- 172.21.15.143:0/1960078177 learned_addr learned my addr 172.21.15.143:0/1960078177 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.381+0000 7fb7510e1640 1 -- 172.21.15.143:0/1960078177 >> v2:172.21.15.163:3300/0 conn(0x7fb7440e40f0 msgr2=0x7fb7440539e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T10:23:59.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.381+0000 7fb7510e1640 1 --2- 172.21.15.143:0/1960078177 >> v2:172.21.15.163:3300/0 conn(0x7fb7440e40f0 0x7fb7440539e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.381+0000 7fb7510e1640 1 -- 172.21.15.143:0/1960078177 >> v1:172.21.15.163:6789/0 conn(0x7fb7440dfee0 legacy=0x7fb7440085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T10:23:59.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.381+0000 7fb7510e1640 1 -- 172.21.15.143:0/1960078177 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb744056860 con 0x7fb7440e02c0 2024-05-08T10:23:59.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.383+0000 7fb7510e1640 1 --2- 172.21.15.143:0/1960078177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440e02c0 0x7fb7440e3bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb74c063f70 tx=0x7fb74c0a8c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b6c4496b471738 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.383+0000 7fb7508e0640 1 -- 172.21.15.143:0/1960078177 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c0705b0 con 0x7fb7440e02c0 2024-05-08T10:23:59.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.383+0000 7fb7508e0640 1 -- 172.21.15.143:0/1960078177 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74c070790 con 0x7fb7440e02c0 2024-05-08T10:23:59.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.384+0000 7fb753b46640 1 -- 172.21.15.143:0/1960078177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440e02c0 msgr2=0x7fb7440e3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.384+0000 7fb753b46640 1 --2- 172.21.15.143:0/1960078177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440e02c0 0x7fb7440e3bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb74c063f70 tx=0x7fb74c0a8c30 comp rx=0 tx=0).stop 2024-05-08T10:23:59.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.385+0000 7fb753b46640 1 -- 172.21.15.143:0/1960078177 shutdown_connections 2024-05-08T10:23:59.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.385+0000 7fb753b46640 1 --2- 172.21.15.143:0/1960078177 >> v2:172.21.15.163:3300/0 conn(0x7fb7440e40f0 0x7fb7440539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.385+0000 7fb753b46640 1 --2- 172.21.15.143:0/1960078177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440e02c0 0x7fb7440e3bb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.385+0000 7fb753b46640 1 -- 172.21.15.143:0/1960078177 >> 172.21.15.143:0/1960078177 conn(0x7fb74401ef30 msgr2=0x7fb744055c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.370 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.385+0000 7fb753b46640 1 -- 172.21.15.143:0/1960078177 shutdown_connections 2024-05-08T10:23:59.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.385+0000 7fb753b46640 1 -- 172.21.15.143:0/1960078177 wait complete. 2024-05-08T10:23:59.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.387+0000 7fb753b46640 1 Processor -- start 2024-05-08T10:23:59.372 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.387+0000 7fb753b46640 1 -- start start 2024-05-08T10:23:59.374 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.389+0000 7fb753b46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440dfee0 0x7fb7440cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.389+0000 7fb7518e2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440dfee0 0x7fb7440cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.389+0000 7fb7518e2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440dfee0 0x7fb7440cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36218/0 (socket says 172.21.15.143:36218) 2024-05-08T10:23:59.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.389+0000 7fb7518e2640 1 -- 172.21.15.143:0/2416903798 learned_addr learned my addr 172.21.15.143:0/2416903798 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.389+0000 7fb753b46640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7440e40f0 0x7fb74404d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.390+0000 7fb753b46640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb74404bc90 0x7fb7440d3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.390+0000 7fb753b46640 1 -- 172.21.15.143:0/2416903798 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb744056b40 con 0x7fb7440dfee0 2024-05-08T10:23:59.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.390+0000 7fb7510e1640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7440e40f0 0x7fb74404d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.375 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.390+0000 7fb753b46640 1 -- 172.21.15.143:0/2416903798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb744009130 con 0x7fb74404bc90 2024-05-08T10:23:59.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.390+0000 7fb753b46640 1 -- 172.21.15.143:0/2416903798 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb7440e4900 con 0x7fb7440e40f0 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.390+0000 7fb7520e3640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb74404bc90 0x7fb7440d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.391+0000 7fb7518e2640 1 -- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7440e40f0 msgr2=0x7fb74404d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.391+0000 7fb7518e2640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7440e40f0 0x7fb74404d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.391+0000 7fb7518e2640 1 -- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb74404bc90 msgr2=0x7fb7440d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.391+0000 7fb7518e2640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb74404bc90 0x7fb7440d3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.391+0000 7fb7518e2640 1 -- 172.21.15.143:0/2416903798 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74404abf0 con 0x7fb7440dfee0 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.391+0000 7fb7520e3640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb74404bc90 0x7fb7440d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.391+0000 7fb7510e1640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7440e40f0 0x7fb74404d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.391+0000 7fb7518e2640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440dfee0 0x7fb7440cfa20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb74800b480 tx=0x7fb74800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.392+0000 7fb7427fc640 1 -- 172.21.15.143:0/2416903798 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748014070 con 0x7fb7440dfee0 2024-05-08T10:23:59.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.392+0000 7fb753b46640 1 -- 172.21.15.143:0/2416903798 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74404aed0 con 0x7fb7440dfee0 2024-05-08T10:23:59.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.392+0000 7fb753b46640 1 -- 172.21.15.143:0/2416903798 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb74404b490 con 0x7fb7440dfee0 2024-05-08T10:23:59.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.395+0000 7fb753b46640 1 -- 172.21.15.143:0/2416903798 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7440057d0 con 0x7fb7440dfee0 2024-05-08T10:23:59.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.406+0000 7fb7427fc640 1 -- 172.21.15.143:0/2416903798 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb748010890 con 0x7fb7440dfee0 2024-05-08T10:23:59.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.406+0000 7fb7427fc640 1 -- 172.21.15.143:0/2416903798 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748010c80 con 0x7fb7440dfee0 2024-05-08T10:23:59.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.407+0000 7fb7427fc640 1 -- 172.21.15.143:0/2416903798 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb748017070 con 0x7fb7440dfee0 2024-05-08T10:23:59.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.408+0000 7fb7427fc640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb738076510 0x7fb7380789d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.408+0000 7fb7510e1640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb738076510 0x7fb7380789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.408+0000 7fb7427fc640 1 -- 172.21.15.143:0/2416903798 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb7480978f0 con 0x7fb7440dfee0 2024-05-08T10:23:59.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.409+0000 7fb7427fc640 1 -- 172.21.15.143:0/2416903798 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb7480c6a30 con 0x7fb7440dfee0 2024-05-08T10:23:59.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.409+0000 7fb7510e1640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb738076510 0x7fb7380789d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb74400afe0 tx=0x7fb74c0ad000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.431+0000 7f996c7da640 1 Processor -- start 2024-05-08T10:23:59.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.431+0000 7f996c7da640 1 -- start start 2024-05-08T10:23:59.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.432+0000 7f48010d0640 1 Processor -- start 2024-05-08T10:23:59.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.432+0000 7f48010d0640 1 -- start start 2024-05-08T10:23:59.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.433+0000 7f996c7da640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f99640d1aa0 0x7f996415f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.433+0000 7f996c7da640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99640726e0 con 0x7f99640b4cb0 2024-05-08T10:23:59.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.433+0000 7f996c7da640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996406e590 con 0x7f9964073ed0 2024-05-08T10:23:59.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.433+0000 7f996c7da640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f99640b5090 con 0x7f99640d1aa0 2024-05-08T10:23:59.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.433+0000 7f996a576640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f99640b4cb0 0x7f996415b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39068/0 (socket says 172.21.15.143:39068) 2024-05-08T10:23:59.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.433+0000 7f996a576640 1 -- 172.21.15.143:0/2008415053 learned_addr learned my addr 172.21.15.143:0/2008415053 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:59.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.433+0000 7f996ad77640 1 --2- 172.21.15.143:0/2008415053 >> v2:172.21.15.143:3300/0 conn(0x7f99640d1aa0 0x7f996415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f996ad77640 1 -- 172.21.15.143:0/2008415053 >> v1:172.21.15.163:6789/0 conn(0x7f9964073ed0 legacy=0x7f99640d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f48010d0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f47f4033990 0x7f47f4037c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f48010d0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f40543c0 con 0x7f47f4038180 2024-05-08T10:23:59.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f48010d0640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f40069d0 con 0x7f47f404f290 2024-05-08T10:23:59.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f48010d0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f47f4053e00 con 0x7f47f4033990 2024-05-08T10:23:59.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f996ad77640 1 -- 172.21.15.143:0/2008415053 >> v1:172.21.15.143:6789/0 conn(0x7f99640b4cb0 legacy=0x7f996415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f996ad77640 1 -- 172.21.15.143:0/2008415053 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996406e870 con 0x7f99640d1aa0 2024-05-08T10:23:59.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f48008cf640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f47f4038180 0x7f47f404f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39078/0 (socket says 172.21.15.143:39078) 2024-05-08T10:23:59.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f47fb7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f47f4033990 0x7f47f4037c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f48008cf640 1 -- 172.21.15.143:0/3501376262 learned_addr learned my addr 172.21.15.143:0/3501376262 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:59.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f47fb7fe640 1 -- 172.21.15.143:0/3501376262 >> v1:172.21.15.163:6789/0 conn(0x7f47f404f290 legacy=0x7f47f4007190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T10:23:59.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f47fb7fe640 1 -- 172.21.15.143:0/3501376262 >> v1:172.21.15.143:6789/0 conn(0x7f47f4038180 legacy=0x7f47f404f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.434+0000 7f47fb7fe640 1 -- 172.21.15.143:0/3501376262 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f40540e0 con 0x7f47f4033990 2024-05-08T10:23:59.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.435+0000 7f725f2b0640 1 Processor -- start 2024-05-08T10:23:59.421 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7f996ad77640 1 --2- 172.21.15.143:0/2008415053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 0x7f996415f270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f995400aba0 tx=0x7f995402b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505facdb311d6158 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7f725f2b0640 1 -- start start 2024-05-08T10:23:59.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7f653f278640 1 Processor -- start 2024-05-08T10:23:59.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7f653f278640 1 -- start start 2024-05-08T10:23:59.422 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7f9969574640 1 -- 172.21.15.143:0/2008415053 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995400b040 con 0x7f99640d1aa0 2024-05-08T10:23:59.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7face6fbe640 1 Processor -- start 2024-05-08T10:23:59.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7face6fbe640 1 -- start start 2024-05-08T10:23:59.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7f9969574640 1 -- 172.21.15.143:0/2008415053 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9954032600 con 0x7f99640d1aa0 2024-05-08T10:23:59.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7f83b07f7640 1 Processor -- start 2024-05-08T10:23:59.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7f47fb7fe640 1 --2- 172.21.15.143:0/3501376262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4033990 0x7f47f4037c40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bbd0fc7a3df22f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7f9969574640 1 -- 172.21.15.143:0/2008415053 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540329d0 con 0x7f99640d1aa0 2024-05-08T10:23:59.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.436+0000 7f83b07f7640 1 -- start start 2024-05-08T10:23:59.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7f725f2b0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7250048100 0x7f7250006f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7f996c7da640 1 -- 172.21.15.143:0/2008415053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 msgr2=0x7f996415f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7f996c7da640 1 --2- 172.21.15.143:0/2008415053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 0x7f996415f270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f995400aba0 tx=0x7f995402b670 comp rx=0 tx=0).stop 2024-05-08T10:23:59.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7f725f2b0640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7250007460 0x7f7250053e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7f725f2b0640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72500547a0 con 0x7f7250054390 2024-05-08T10:23:59.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7f725f2b0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f72500e7b90 con 0x7f7250048100 2024-05-08T10:23:59.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7f725f2b0640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7250006a90 con 0x7f7250007460 2024-05-08T10:23:59.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7face6fbe640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7facd8055d10 0x7facd80366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f996c7da640 1 -- 172.21.15.143:0/2008415053 shutdown_connections 2024-05-08T10:23:59.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f996c7da640 1 --2- 172.21.15.143:0/2008415053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 0x7f996415f270 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f996c7da640 1 -- 172.21.15.143:0/2008415053 >> 172.21.15.143:0/2008415053 conn(0x7f996406c740 msgr2=0x7f996406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653f278640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f653813ee60 0x7f65380d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653f278640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65380d0bf0 0x7f653815fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653f278640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65380d1150 con 0x7f653815ff50 2024-05-08T10:23:59.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653f278640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f65380d1430 con 0x7f653813ee60 2024-05-08T10:23:59.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653f278640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f65380d1710 con 0x7f65380d0bf0 2024-05-08T10:23:59.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f47faffd640 1 -- 172.21.15.143:0/3501376262 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8037070 con 0x7f47f4033990 2024-05-08T10:23:59.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f47faffd640 1 -- 172.21.15.143:0/3501376262 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e8032440 con 0x7f47f4033990 2024-05-08T10:23:59.427 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f47faffd640 1 -- 172.21.15.143:0/3501376262 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8037070 con 0x7f47f4033990 2024-05-08T10:23:59.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653da75640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65380d0bf0 0x7f653815fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653da75640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65380d0bf0 0x7f653815fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59260/0 (socket says 172.21.15.143:59260) 2024-05-08T10:23:59.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653da75640 1 -- 172.21.15.143:0/2223650609 learned_addr learned my addr 172.21.15.143:0/2223650609 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f83b07f7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f83a00dfee0 0x7f83a00085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.428 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653e276640 1 --2- 172.21.15.143:0/2223650609 >> v2:172.21.15.143:3300/0 conn(0x7f653813ee60 0x7f65380d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7face6fbe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 0x7facd8006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7face6fbe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd8036be0 con 0x7facd80df770 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7face6fbe640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7facd8050150 con 0x7facd8055d10 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.437+0000 7face6fbe640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7facd8006c30 con 0x7facd8006220 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face57bb640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7facd80df770 0x7facd804fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39090/0 (socket says 172.21.15.143:39090) 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face57bb640 1 -- 172.21.15.143:0/1936995498 learned_addr learned my addr 172.21.15.143:0/1936995498 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face67bd640 1 --2- 172.21.15.143:0/1936995498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 0x7facd8006630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f725d04c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7250048100 0x7f7250006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f725d04c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7250048100 0x7f7250006f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36234/0 (socket says 172.21.15.143:36234) 2024-05-08T10:23:59.429 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f725d04c640 1 -- 172.21.15.143:0/2982294491 learned_addr learned my addr 172.21.15.143:0/2982294491 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f725c84b640 1 --2- 172.21.15.143:0/2982294491 >> v2:172.21.15.163:3300/0 conn(0x7f7250007460 0x7f7250053e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face4fba640 1 -- 172.21.15.143:0/1936995498 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791424004 0 0) 0x7facdc001110 con 0x7facd80df770 2024-05-08T10:23:59.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face4fba640 1 -- 172.21.15.143:0/1936995498 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faccc003520 con 0x7facd80df770 2024-05-08T10:23:59.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face5fbc640 1 --2- 172.21.15.143:0/1936995498 >> v2:172.21.15.163:3300/0 conn(0x7facd8055d10 0x7facd80366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face67bd640 1 -- 172.21.15.143:0/1936995498 >> v2:172.21.15.163:3300/0 conn(0x7facd8055d10 msgr2=0x7facd80366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:59.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face67bd640 1 --2- 172.21.15.143:0/1936995498 >> v2:172.21.15.163:3300/0 conn(0x7facd8055d10 0x7facd80366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face67bd640 1 -- 172.21.15.143:0/1936995498 >> v1:172.21.15.143:6789/0 conn(0x7facd80df770 legacy=0x7facd804fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.430 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7face67bd640 1 -- 172.21.15.143:0/1936995498 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd8006f10 con 0x7facd8006220 2024-05-08T10:23:59.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f996c7da640 1 -- 172.21.15.143:0/2008415053 shutdown_connections 2024-05-08T10:23:59.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f48010d0640 1 -- 172.21.15.143:0/3501376262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4033990 msgr2=0x7f47f4037c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f48010d0640 1 --2- 172.21.15.143:0/3501376262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4033990 0x7f47f4037c40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e802a1a0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f725d04c640 1 -- 172.21.15.143:0/2982294491 >> v2:172.21.15.163:3300/0 conn(0x7f7250007460 msgr2=0x7f7250053e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:59.431 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7face67bd640 1 --2- 172.21.15.143:0/1936995498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 0x7facd8006630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7face00514f0 tx=0x7face00a6d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e0004034e10ac97 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f83add92640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f83a00e02c0 0x7f83a00e3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:53276/0 (socket says 172.21.15.143:53276) 2024-05-08T10:23:59.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f83add92640 1 -- 172.21.15.143:0/55688686 learned_addr learned my addr 172.21.15.143:0/55688686 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:23:59.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f83b07f7640 1 -- 172.21.15.143:0/55688686 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a0056580 con 0x7f83a00e42c0 2024-05-08T10:23:59.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f83b07f7640 1 -- 172.21.15.143:0/55688686 --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a0056860 con 0x7f83a00e02c0 2024-05-08T10:23:59.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f83b07f7640 1 -- 172.21.15.143:0/55688686 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f83a00094a0 con 0x7f83a00dfee0 2024-05-08T10:23:59.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152987525 0 0) 0x7f83a0056860 con 0x7f83a00e02c0 2024-05-08T10:23:59.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8394003520 con 0x7f83a00e02c0 2024-05-08T10:23:59.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f83ae593640 1 --2- 172.21.15.143:0/55688686 >> v2:172.21.15.143:3300/0 conn(0x7f83a00dfee0 0x7f83a00085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f725d04c640 1 --2- 172.21.15.143:0/2982294491 >> v2:172.21.15.163:3300/0 conn(0x7f7250007460 0x7f7250053e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f725d04c640 1 -- 172.21.15.143:0/2982294491 >> v1:172.21.15.163:6789/0 conn(0x7f7250054390 legacy=0x7f725004f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f725d04c640 1 -- 172.21.15.143:0/2982294491 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7250005ec0 con 0x7f7250048100 2024-05-08T10:23:59.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f48010d0640 1 -- 172.21.15.143:0/3501376262 shutdown_connections 2024-05-08T10:23:59.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f48010d0640 1 --2- 172.21.15.143:0/3501376262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4033990 0x7f47f4037c40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7f48010d0640 1 -- 172.21.15.143:0/3501376262 >> 172.21.15.143:0/3501376262 conn(0x7f47f4009fb0 msgr2=0x7f47f400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653da75640 1 -- 172.21.15.143:0/2223650609 >> v2:172.21.15.143:3300/0 conn(0x7f653813ee60 msgr2=0x7f65380d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:59.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653da75640 1 --2- 172.21.15.143:0/2223650609 >> v2:172.21.15.143:3300/0 conn(0x7f653813ee60 0x7f65380d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653da75640 1 -- 172.21.15.143:0/2223650609 >> v1:172.21.15.143:6789/0 conn(0x7f653815ff50 legacy=0x7f653815c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.438+0000 7f653da75640 1 -- 172.21.15.143:0/2223650609 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65380d19f0 con 0x7f65380d0bf0 2024-05-08T10:23:59.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.439+0000 7face4fba640 1 -- 172.21.15.143:0/1936995498 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face00b4070 con 0x7facd8006220 2024-05-08T10:23:59.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7face4fba640 1 -- 172.21.15.143:0/1936995498 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face00a7b50 con 0x7facd8006220 2024-05-08T10:23:59.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7face4fba640 1 -- 172.21.15.143:0/1936995498 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face00b4070 con 0x7facd8006220 2024-05-08T10:23:59.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f48010d0640 1 -- 172.21.15.143:0/3501376262 shutdown_connections 2024-05-08T10:23:59.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f48010d0640 1 -- 172.21.15.143:0/3501376262 wait complete. 2024-05-08T10:23:59.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f996c7da640 1 -- 172.21.15.143:0/2008415053 wait complete. 2024-05-08T10:23:59.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f725d04c640 1 --2- 172.21.15.143:0/2982294491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 0x7f7250006f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7258063f70 tx=0x7f72580a6e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851d1974de724d42 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2176670815 0 0) 0x7f8394003520 con 0x7f83a00e02c0 2024-05-08T10:23:59.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 >> v2:172.21.15.143:3300/0 conn(0x7f83a00dfee0 msgr2=0x7f83a00085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 --2- 172.21.15.143:0/55688686 >> v2:172.21.15.143:3300/0 conn(0x7f83a00dfee0 0x7f83a00085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 >> v1:172.21.15.143:6789/0 conn(0x7f83a00e42c0 legacy=0x7f83a00539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a0008e50 con 0x7f83a00e02c0 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f83980016f0 con 0x7f83a00e02c0 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 >> v1:172.21.15.163:6789/0 conn(0x7f83a00e02c0 legacy=0x7f83a00e3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940039b0 0x7f8394003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8394004360 0x7f8394004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8394005040 0x7f839400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f83a00094a0 con 0x7f8394004360 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f839400bf00 con 0x7f8394005040 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f839400c100 con 0x7f83940039b0 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ae593640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940039b0 0x7f8394003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83add92640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8394004360 0x7f8394004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ae593640 1 -- 172.21.15.143:0/55688686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8394005040 msgr2=0x7f839400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:59.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ae593640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8394005040 0x7f839400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ae593640 1 -- 172.21.15.143:0/55688686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8394004360 msgr2=0x7f8394004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:59.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ae593640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8394004360 0x7f8394004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83ae593640 1 -- 172.21.15.143:0/55688686 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8394003520 con 0x7f83940039b0 2024-05-08T10:23:59.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f83add92640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8394004360 0x7f8394004840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:23:59.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7face6fbe640 1 -- 172.21.15.143:0/1936995498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 msgr2=0x7facd8006630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7face6fbe640 1 --2- 172.21.15.143:0/1936995498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 0x7facd8006630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7face00514f0 tx=0x7face00a6d00 comp rx=0 tx=0).stop 2024-05-08T10:23:59.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f83aed94640 1 -- 172.21.15.143:0/55688686 reap_dead start 2024-05-08T10:23:59.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f653da75640 1 --2- 172.21.15.143:0/2223650609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65380d0bf0 0x7f653815fa10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6534009870 tx=0x7f653402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=353a93cbdc90d6de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f724ffff640 1 -- 172.21.15.143:0/2982294491 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72580b4070 con 0x7f7250048100 2024-05-08T10:23:59.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f724ffff640 1 -- 172.21.15.143:0/2982294491 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72580a7c10 con 0x7f7250048100 2024-05-08T10:23:59.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.440+0000 7f724ffff640 1 -- 172.21.15.143:0/2982294491 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72580af640 con 0x7f7250048100 2024-05-08T10:23:59.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7face6fbe640 1 -- 172.21.15.143:0/1936995498 shutdown_connections 2024-05-08T10:23:59.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7face6fbe640 1 --2- 172.21.15.143:0/1936995498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 0x7facd8006630 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7face6fbe640 1 --2- 172.21.15.143:0/1936995498 >> v2:172.21.15.163:3300/0 conn(0x7facd8055d10 0x7facd80366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7face6fbe640 1 -- 172.21.15.143:0/1936995498 >> 172.21.15.143:0/1936995498 conn(0x7facd801e6c0 msgr2=0x7facd80553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f725f2b0640 1 -- 172.21.15.143:0/2982294491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 msgr2=0x7f7250006f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7face6fbe640 1 -- 172.21.15.143:0/1936995498 shutdown_connections 2024-05-08T10:23:59.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2982294491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 0x7f7250006f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7258063f70 tx=0x7f72580a6e00 comp rx=0 tx=0).stop 2024-05-08T10:23:59.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f725f2b0640 1 -- 172.21.15.143:0/2982294491 shutdown_connections 2024-05-08T10:23:59.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f653d274640 1 -- 172.21.15.143:0/2223650609 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534037070 con 0x7f65380d0bf0 2024-05-08T10:23:59.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2982294491 >> v2:172.21.15.163:3300/0 conn(0x7f7250007460 0x7f7250053e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f48010d0640 1 Processor -- start 2024-05-08T10:23:59.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7face6fbe640 1 -- 172.21.15.143:0/1936995498 wait complete. 2024-05-08T10:23:59.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f653d274640 1 -- 172.21.15.143:0/2223650609 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6534032440 con 0x7f65380d0bf0 2024-05-08T10:23:59.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f653d274640 1 -- 172.21.15.143:0/2223650609 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534032810 con 0x7f65380d0bf0 2024-05-08T10:23:59.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2982294491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 0x7f7250006f20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f83ae593640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940039b0 0x7f8394003d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009aa0 tx=0x7f8394005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a59def6db149e25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f725f2b0640 1 -- 172.21.15.143:0/2982294491 >> 172.21.15.143:0/2982294491 conn(0x7f7250009fe0 msgr2=0x7f725000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f996c7da640 1 Processor -- start 2024-05-08T10:23:59.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.441+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4036070 con 0x7f83940039b0 2024-05-08T10:23:59.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a4031400 con 0x7f83940039b0 2024-05-08T10:23:59.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f83ad591640 1 -- 172.21.15.143:0/55688686 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4009670 con 0x7f83940039b0 2024-05-08T10:23:59.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f48010d0640 1 -- start start 2024-05-08T10:23:59.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f0bf1a15640 1 Processor -- start 2024-05-08T10:23:59.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f725f2b0640 1 -- 172.21.15.143:0/2982294491 shutdown_connections 2024-05-08T10:23:59.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f0bf1a15640 1 -- start start 2024-05-08T10:23:59.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f725f2b0640 1 -- 172.21.15.143:0/2982294491 wait complete. 2024-05-08T10:23:59.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f48010d0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f4033990 0x7f47f40e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f996c7da640 1 -- start start 2024-05-08T10:23:59.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f48010d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4038180 0x7f47f40f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f48010d0640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f404f290 0x7f47f40344e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f48010d0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4054730 con 0x7f47f4038180 2024-05-08T10:23:59.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f48010d0640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f47f40545b0 con 0x7f47f404f290 2024-05-08T10:23:59.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f48010d0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f47f40385b0 con 0x7f47f4033990 2024-05-08T10:23:59.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f653f278640 1 -- 172.21.15.143:0/2223650609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65380d0bf0 msgr2=0x7f653815fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f653f278640 1 --2- 172.21.15.143:0/2223650609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65380d0bf0 0x7f653815fa10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6534009870 tx=0x7f653402a270 comp rx=0 tx=0).stop 2024-05-08T10:23:59.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f83b07f7640 1 -- 172.21.15.143:0/55688686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940039b0 msgr2=0x7f8394003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.442+0000 7f83b07f7640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940039b0 0x7f8394003d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009aa0 tx=0x7f8394005830 comp rx=0 tx=0).stop 2024-05-08T10:23:59.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f83b07f7640 1 -- 172.21.15.143:0/55688686 shutdown_connections 2024-05-08T10:23:59.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f83b07f7640 1 --2- 172.21.15.143:0/55688686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940039b0 0x7f8394003d90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f83b07f7640 1 -- 172.21.15.143:0/55688686 >> 172.21.15.143:0/55688686 conn(0x7f83a001ef30 msgr2=0x7f83a0055c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f83b07f7640 1 -- 172.21.15.143:0/55688686 shutdown_connections 2024-05-08T10:23:59.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f653f278640 1 -- 172.21.15.143:0/2223650609 shutdown_connections 2024-05-08T10:23:59.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f653f278640 1 --2- 172.21.15.143:0/2223650609 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65380d0bf0 0x7f653815fa10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f653f278640 1 --2- 172.21.15.143:0/2223650609 >> v2:172.21.15.143:3300/0 conn(0x7f653813ee60 0x7f65380d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f653f278640 1 -- 172.21.15.143:0/2223650609 >> 172.21.15.143:0/2223650609 conn(0x7f65380b3c80 msgr2=0x7f65380b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f83b07f7640 1 -- 172.21.15.143:0/55688686 wait complete. 2024-05-08T10:23:59.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f653f278640 1 -- 172.21.15.143:0/2223650609 shutdown_connections 2024-05-08T10:23:59.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f996c7da640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9964073ed0 0x7f9964151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7face6fbe640 1 Processor -- start 2024-05-08T10:23:59.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f47fb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4038180 0x7f47f40f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f47fb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4038180 0x7f47f40f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36270/0 (socket says 172.21.15.143:36270) 2024-05-08T10:23:59.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f47fb7fe640 1 -- 172.21.15.143:0/612706778 learned_addr learned my addr 172.21.15.143:0/612706778 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f47fbfff640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f4033990 0x7f47f40e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f48008cf640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f404f290 0x7f47f40344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f0bf1a15640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0bec15ce30 0x7f0bec0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f0bf1a15640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec160d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f653f278640 1 -- 172.21.15.143:0/2223650609 wait complete. 2024-05-08T10:23:59.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f996c7da640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99640b4cb0 0x7f99640cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f0beb7fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f996a576640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9964073ed0 0x7f9964151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7face6fbe640 1 -- start start 2024-05-08T10:23:59.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0beaffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0bec15ce30 0x7f0bec0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f47fb7fe640 1 -- 172.21.15.143:0/612706778 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f4033990 msgr2=0x7f47f40e2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f47fb7fe640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f4033990 0x7f47f40e2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f47fb7fe640 1 -- 172.21.15.143:0/612706778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f404f290 msgr2=0x7f47f40344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f47fb7fe640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f404f290 0x7f47f40344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f47fb7fe640 1 -- 172.21.15.143:0/612706778 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f4035980 con 0x7f47f4038180 2024-05-08T10:23:59.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0beaffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0bec15ce30 0x7f0bec0ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36274/0 (socket says 172.21.15.143:36274) 2024-05-08T10:23:59.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0beaffd640 1 -- 172.21.15.143:0/2661193176 learned_addr learned my addr 172.21.15.143:0/2661193176 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0beb7fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec160d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59294/0 (socket says 172.21.15.143:59294) 2024-05-08T10:23:59.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0bf1a15640 1 -- 172.21.15.143:0/2661193176 --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bec0b5d60 con 0x7f0bec0b4020 2024-05-08T10:23:59.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0bf1a15640 1 -- 172.21.15.143:0/2661193176 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f0bec0b3810 con 0x7f0bec15ce30 2024-05-08T10:23:59.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0bf1a15640 1 -- 172.21.15.143:0/2661193176 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0bec0b3af0 con 0x7f0bec0d0c60 2024-05-08T10:23:59.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f996a576640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9964073ed0 0x7f9964151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48716/0 (socket says 172.21.15.143:48716) 2024-05-08T10:23:59.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f9969d75640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99640b4cb0 0x7f99640cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f9969d75640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99640b4cb0 0x7f99640cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59306/0 (socket says 172.21.15.143:59306) 2024-05-08T10:23:59.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f996c7da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 0x7f996415d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f996c7da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f996406f110 con 0x7f99640d1aa0 2024-05-08T10:23:59.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0beaffd640 1 -- 172.21.15.143:0/2661193176 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 msgr2=0x7f0bec160d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:23:59.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0beaffd640 1 --2- 172.21.15.143:0/2661193176 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec160d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0beaffd640 1 -- 172.21.15.143:0/2661193176 >> v1:172.21.15.163:6789/0 conn(0x7f0bec0b4020 legacy=0x7f0bec0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f0beaffd640 1 -- 172.21.15.143:0/2661193176 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bec0b6000 con 0x7f0bec15ce30 2024-05-08T10:23:59.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f47fb7fe640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4038180 0x7f47f40f4f20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f83b07f7640 1 Processor -- start 2024-05-08T10:23:59.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f725f2b0640 1 Processor -- start 2024-05-08T10:23:59.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.443+0000 7f725f2b0640 1 -- start start 2024-05-08T10:23:59.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725f2b0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7250007460 0x7f72500e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f83b07f7640 1 -- start start 2024-05-08T10:23:59.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725f2b0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 0x7f7250188c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f653f278640 1 Processor -- start 2024-05-08T10:23:59.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725d04c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7250007460 0x7f72500e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725d04c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7250007460 0x7f72500e38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59318/0 (socket says 172.21.15.143:59318) 2024-05-08T10:23:59.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725c84b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 0x7f7250188c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725c84b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 0x7f7250188c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36290/0 (socket says 172.21.15.143:36290) 2024-05-08T10:23:59.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725d04c640 1 -- 172.21.15.143:0/2665707911 learned_addr learned my addr 172.21.15.143:0/2665707911 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f996c7da640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f996406ee30 con 0x7f9964073ed0 2024-05-08T10:23:59.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7250054390 0x7f7250189510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7250006440 con 0x7f7250048100 2024-05-08T10:23:59.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7250006160 con 0x7f7250054390 2024-05-08T10:23:59.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7250006720 con 0x7f7250007460 2024-05-08T10:23:59.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f996c7da640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f99640704b0 con 0x7f99640b4cb0 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.444+0000 7f9969d75640 1 -- 172.21.15.143:0/1529457387 learned_addr learned my addr 172.21.15.143:0/1529457387 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f996ad77640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 0x7f996415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f9969d75640 1 -- 172.21.15.143:0/1529457387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9964073ed0 msgr2=0x7f9964151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f9969d75640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9964073ed0 0x7f9964151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f9969d75640 1 -- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 msgr2=0x7f996415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f9969d75640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 0x7f996415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f9969d75640 1 -- 172.21.15.143:0/1529457387 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99640b1020 con 0x7f99640b4cb0 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f996ad77640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 0x7f996415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f9969d75640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99640b4cb0 0x7f99640cd900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c820 tx=0x7f995c00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f995affd640 1 -- 172.21.15.143:0/1529457387 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c017070 con 0x7f99640b4cb0 2024-05-08T10:23:59.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725c84b640 1 -- 172.21.15.143:0/2665707911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7250007460 msgr2=0x7f72500e38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725c84b640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7250007460 0x7f72500e38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725c84b640 1 -- 172.21.15.143:0/2665707911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7250054390 msgr2=0x7f7250189510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725c84b640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7250054390 0x7f7250189510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f725c84b640 1 -- 172.21.15.143:0/2665707911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7250189fb0 con 0x7f7250048100 2024-05-08T10:23:59.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f995affd640 1 -- 172.21.15.143:0/1529457387 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c003da0 con 0x7f99640b4cb0 2024-05-08T10:23:59.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f995affd640 1 -- 172.21.15.143:0/1529457387 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c005290 con 0x7f99640b4cb0 2024-05-08T10:23:59.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99640b1300 con 0x7f99640b4cb0 2024-05-08T10:23:59.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83b07f7640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940039b0 0x7f83a004b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83b07f7640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83a004bdf0 0x7f83a0049720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f0beaffd640 1 --2- 172.21.15.143:0/2661193176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec15ce30 0x7f0bec0ae190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0be00098a0 tx=0x7f0be002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3d890a10ed8060 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83b07f7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83a0049c60 0x7f83a017d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f99640b18c0 con 0x7f99640b4cb0 2024-05-08T10:23:59.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83b07f7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f83a00e4900 con 0x7f83a0049c60 2024-05-08T10:23:59.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83b07f7640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0056b40 con 0x7f83940039b0 2024-05-08T10:23:59.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83b07f7640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f83a00e3bb0 con 0x7f83a004bdf0 2024-05-08T10:23:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83add92640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83a004bdf0 0x7f83a0049720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83add92640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83a004bdf0 0x7f83a0049720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59334/0 (socket says 172.21.15.143:59334) 2024-05-08T10:23:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83add92640 1 -- 172.21.15.143:0/4282116981 learned_addr learned my addr 172.21.15.143:0/4282116981 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83ae593640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940039b0 0x7f83a004b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.445+0000 7f653f278640 1 -- start start 2024-05-08T10:23:59.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83aed94640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83a0049c60 0x7f83a017d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f47f8ff9640 1 -- 172.21.15.143:0/612706778 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8042070 con 0x7f47f4038180 2024-05-08T10:23:59.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f4035c60 con 0x7f47f4038180 2024-05-08T10:23:59.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f402fc90 con 0x7f47f4038180 2024-05-08T10:23:59.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f47f8ff9640 1 -- 172.21.15.143:0/612706778 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e8030980 con 0x7f47f4038180 2024-05-08T10:23:59.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f47f8ff9640 1 -- 172.21.15.143:0/612706778 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8037070 con 0x7f47f4038180 2024-05-08T10:23:59.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f0be9ffb640 1 -- 172.21.15.143:0/2661193176 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0037070 con 0x7f0bec15ce30 2024-05-08T10:23:59.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f0be9ffb640 1 -- 172.21.15.143:0/2661193176 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be0032440 con 0x7f0bec15ce30 2024-05-08T10:23:59.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f0be9ffb640 1 -- 172.21.15.143:0/2661193176 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0037070 con 0x7f0bec15ce30 2024-05-08T10:23:59.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f653f278640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65380d0bf0 0x7f653813a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f653f278640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f653813ee60 0x7f6538139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f653f278640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f653815ff50 0x7f653815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f653f278640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f65380b6350 con 0x7f653813ee60 2024-05-08T10:23:59.467 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f653f278640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6538071b50 con 0x7f65380d0bf0 2024-05-08T10:23:59.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f653f278640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f65380b64d0 con 0x7f653815ff50 2024-05-08T10:23:59.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7face6fbe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 0x7facd8054120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7f0bf1a15640 1 -- 172.21.15.143:0/2661193176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec15ce30 msgr2=0x7f0bec0ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7f0bf1a15640 1 --2- 172.21.15.143:0/2661193176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec15ce30 0x7f0bec0ae190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0be00098a0 tx=0x7f0be002a2c0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7face6fbe640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facd8055d10 0x7facd8054660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7face6fbe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facd80df770 0x7facd80de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7face57bb640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facd8055d10 0x7facd8054660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7face57bb640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facd8055d10 0x7facd8054660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:48768/0 (socket says 172.21.15.143:48768) 2024-05-08T10:23:59.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7face57bb640 1 -- 172.21.15.143:0/865326443 learned_addr learned my addr 172.21.15.143:0/865326443 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7facd80560f0 con 0x7facd80df770 2024-05-08T10:23:59.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7facd80074d0 con 0x7facd8055d10 2024-05-08T10:23:59.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7facd80dfbe0 con 0x7facd8006220 2024-05-08T10:23:59.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83add92640 1 -- 172.21.15.143:0/4282116981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940039b0 msgr2=0x7f83a004b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83add92640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940039b0 0x7f83a004b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83add92640 1 -- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83a0049c60 msgr2=0x7f83a017d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83add92640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83a0049c60 0x7f83a017d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.446+0000 7f83add92640 1 -- 172.21.15.143:0/4282116981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a004a490 con 0x7f83a004bdf0 2024-05-08T10:23:59.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7f83add92640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83a004bdf0 0x7f83a0049720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8398007310 tx=0x7f83980077d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7f839effd640 1 -- 172.21.15.143:0/4282116981 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839800fae0 con 0x7f83a004bdf0 2024-05-08T10:23:59.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7f839effd640 1 -- 172.21.15.143:0/4282116981 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8398018070 con 0x7f83a004bdf0 2024-05-08T10:23:59.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7f839effd640 1 -- 172.21.15.143:0/4282116981 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839800fe80 con 0x7f83a004bdf0 2024-05-08T10:23:59.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a00e0900 con 0x7f83a004bdf0 2024-05-08T10:23:59.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a00e0ec0 con 0x7f83a004bdf0 2024-05-08T10:23:59.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.447+0000 7f725c84b640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 0x7f7250188c90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f725400d5f0 tx=0x7f725400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7face67bd640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facd80df770 0x7facd80de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7face5fbc640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 0x7facd8054120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7f653ea77640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f653815ff50 0x7f653815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7f653ea77640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f653815ff50 0x7f653815b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:59338/0 (socket says 172.21.15.143:59338) 2024-05-08T10:23:59.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7f653ea77640 1 -- 172.21.15.143:0/706511210 learned_addr learned my addr 172.21.15.143:0/706511210 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7f653da75640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f653813ee60 0x7f6538139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7f653e276640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65380d0bf0 0x7f653813a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99640b57a0 con 0x7f99640b4cb0 2024-05-08T10:23:59.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7face67bd640 1 -- 172.21.15.143:0/865326443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 msgr2=0x7facd8054120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7face67bd640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 0x7facd8054120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7face67bd640 1 -- 172.21.15.143:0/865326443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facd8055d10 msgr2=0x7facd8054660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7face67bd640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facd8055d10 0x7facd8054660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.448+0000 7face67bd640 1 -- 172.21.15.143:0/865326443 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd80edfb0 con 0x7facd80df770 2024-05-08T10:23:59.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7face67bd640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facd80df770 0x7facd80de4d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7face00520f0 tx=0x7face006b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f653da75640 1 -- 172.21.15.143:0/706511210 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f653815ff50 msgr2=0x7f653815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f653da75640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f653815ff50 0x7f653815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f653da75640 1 -- 172.21.15.143:0/706511210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65380d0bf0 msgr2=0x7f653813a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f653da75640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65380d0bf0 0x7f653813a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f653da75640 1 -- 172.21.15.143:0/706511210 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653813f240 con 0x7f653813ee60 2024-05-08T10:23:59.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f995affd640 1 -- 172.21.15.143:0/1529457387 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f995c01a070 con 0x7f99640b4cb0 2024-05-08T10:23:59.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f653da75640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f653813ee60 0x7f6538139bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6534031000 tx=0x7f65340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f995affd640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99480762d0 0x7f9948078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f0bf1a15640 1 -- 172.21.15.143:0/2661193176 shutdown_connections 2024-05-08T10:23:59.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f0bf1a15640 1 --2- 172.21.15.143:0/2661193176 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec160d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f0bf1a15640 1 --2- 172.21.15.143:0/2661193176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec15ce30 0x7f0bec0ae190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.475 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f0bf1a15640 1 -- 172.21.15.143:0/2661193176 >> 172.21.15.143:0/2661193176 conn(0x7f0bec0b6760 msgr2=0x7f0bec0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.450+0000 7f995affd640 1 -- 172.21.15.143:0/1529457387 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f995c096ca0 con 0x7f99640b4cb0 2024-05-08T10:23:59.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.450+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f402fe90 con 0x7f47f4038180 2024-05-08T10:23:59.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f724dffb640 1 -- 172.21.15.143:0/2665707911 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72540125f0 con 0x7f7250048100 2024-05-08T10:23:59.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725018a290 con 0x7f7250048100 2024-05-08T10:23:59.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7250034730 con 0x7f7250048100 2024-05-08T10:23:59.476 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f724dffb640 1 -- 172.21.15.143:0/2665707911 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7254019070 con 0x7f7250048100 2024-05-08T10:23:59.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f724dffb640 1 -- 172.21.15.143:0/2665707911 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72540129d0 con 0x7f7250048100 2024-05-08T10:23:59.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a00e10c0 con 0x7f83a004bdf0 2024-05-08T10:23:59.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.449+0000 7f839effd640 1 -- 172.21.15.143:0/4282116981 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f839801d460 con 0x7f83a004bdf0 2024-05-08T10:23:59.477 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.450+0000 7f996a576640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99480762d0 0x7f9948078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.450+0000 7f839effd640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f838c0763d0 0x7f838c078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.450+0000 7f47f8ff9640 1 -- 172.21.15.143:0/612706778 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f47e8045070 con 0x7f47f4038180 2024-05-08T10:23:59.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.450+0000 7f839effd640 1 -- 172.21.15.143:0/4282116981 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8398097650 con 0x7f83a004bdf0 2024-05-08T10:23:59.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.450+0000 7f652effd640 1 -- 172.21.15.143:0/706511210 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534041070 con 0x7f653813ee60 2024-05-08T10:23:59.478 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.450+0000 7f652effd640 1 -- 172.21.15.143:0/706511210 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653403c8b0 con 0x7f653813ee60 2024-05-08T10:23:59.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.450+0000 7f652effd640 1 -- 172.21.15.143:0/706511210 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534037040 con 0x7f653813ee60 2024-05-08T10:23:59.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7f83ae593640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f838c0763d0 0x7f838c078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7f47f8ff9640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f47e00763a0 0x7f47e0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653813f520 con 0x7f653813ee60 2024-05-08T10:23:59.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653813fae0 con 0x7f653813ee60 2024-05-08T10:23:59.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7f0bf1a15640 1 -- 172.21.15.143:0/2661193176 shutdown_connections 2024-05-08T10:23:59.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7facd67fc640 1 -- 172.21.15.143:0/865326443 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face00be070 con 0x7facd80df770 2024-05-08T10:23:59.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7facd67fc640 1 -- 172.21.15.143:0/865326443 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face00ba6f0 con 0x7facd80df770 2024-05-08T10:23:59.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7facd67fc640 1 -- 172.21.15.143:0/865326443 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face00b4070 con 0x7facd80df770 2024-05-08T10:23:59.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7f83ae593640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f838c0763d0 0x7f838c078890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f83a4033000 tx=0x7f83a4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7f47f8ff9640 1 -- 172.21.15.143:0/612706778 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f47e80b7af0 con 0x7f47f4038180 2024-05-08T10:23:59.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7f47fbfff640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f47e00763a0 0x7f47e0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7238005290 con 0x7f7250048100 2024-05-08T10:23:59.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.451+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd80ee290 con 0x7facd80df770 2024-05-08T10:23:59.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.452+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd80cec40 con 0x7facd80df770 2024-05-08T10:23:59.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.452+0000 7f47fbfff640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f47e00763a0 0x7f47e0078860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47f0006fd0 tx=0x7f47f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.452+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653813e4a0 con 0x7f653813ee60 2024-05-08T10:23:59.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.452+0000 7f996a576640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99480762d0 0x7f9948078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9960012c50 tx=0x7f9960012be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.452+0000 7f0bf1a15640 1 -- 172.21.15.143:0/2661193176 wait complete. 2024-05-08T10:23:59.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.453+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd80057e0 con 0x7facd80df770 2024-05-08T10:23:59.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.453+0000 7f724dffb640 1 -- 172.21.15.143:0/2665707911 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7254012b70 con 0x7f7250048100 2024-05-08T10:23:59.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.453+0000 7f724dffb640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f723c0762d0 0x7f723c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.453+0000 7f725d04c640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f723c0762d0 0x7f723c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.454+0000 7f995affd640 1 -- 172.21.15.143:0/1529457387 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f99640b57a0 con 0x7f99640b4cb0 2024-05-08T10:23:59.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.454+0000 7f725d04c640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f723c0762d0 0x7f723c078790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f725806ba40 tx=0x7f72580ab000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.454+0000 7f0bf1a15640 1 Processor -- start 2024-05-08T10:23:59.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.454+0000 7f0bf1a15640 1 -- start start 2024-05-08T10:23:59.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bf1a15640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec0b4020 0x7f0bec09c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bf1a15640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bf1a15640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0bec15ce30 0x7f0bec0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bf1a15640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec0b3430 con 0x7f0bec0b4020 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0beaffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec0b4020 0x7f0bec09c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0beaffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec0b4020 0x7f0bec09c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36322/0 (socket says 172.21.15.143:36322) 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0beaffd640 1 -- 172.21.15.143:0/1901524865 learned_addr learned my addr 172.21.15.143:0/1901524865 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bf1a15640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec0b5a30 con 0x7f0bec15ce30 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0bec0b35b0 con 0x7f0bec0d0c60 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bea7fc640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0beb7fe640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0bec15ce30 0x7f0bec0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bea7fc640 1 -- 172.21.15.143:0/1901524865 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0bec15ce30 msgr2=0x7f0bec0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bea7fc640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0bec15ce30 0x7f0bec0b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bea7fc640 1 -- 172.21.15.143:0/1901524865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec0b4020 msgr2=0x7f0bec09c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.456+0000 7f0bea7fc640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec0b4020 0x7f0bec09c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.457+0000 7f0bea7fc640 1 -- 172.21.15.143:0/1901524865 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bec09b180 con 0x7f0bec0d0c60 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.457+0000 7f0bea7fc640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec1495b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c6c0 tx=0x7f0be400cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.458+0000 7f0bd3fff640 1 -- 172.21.15.143:0/1901524865 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4003b70 con 0x7f0bec0d0c60 2024-05-08T10:23:59.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.458+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bec09b460 con 0x7f0bec0d0c60 2024-05-08T10:23:59.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.458+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bec09ba20 con 0x7f0bec0d0c60 2024-05-08T10:23:59.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.458+0000 7f839effd640 1 -- 172.21.15.143:0/4282116981 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f83a00e10c0 con 0x7f83a004bdf0 2024-05-08T10:23:59.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.459+0000 7f47f8ff9640 1 -- 172.21.15.143:0/612706778 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f47e8081430 con 0x7f47f4038180 2024-05-08T10:23:59.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.459+0000 7f724dffb640 1 -- 172.21.15.143:0/2665707911 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7254012e60 con 0x7f7250048100 2024-05-08T10:23:59.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.458+0000 7f0bd3fff640 1 -- 172.21.15.143:0/1901524865 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be4003d10 con 0x7f0bec0d0c60 2024-05-08T10:23:59.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.459+0000 7f0bd3fff640 1 -- 172.21.15.143:0/1901524865 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be40052d0 con 0x7f0bec0d0c60 2024-05-08T10:23:59.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.461+0000 7f652effd640 1 -- 172.21.15.143:0/706511210 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6534044070 con 0x7f653813ee60 2024-05-08T10:23:59.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.462+0000 7f652effd640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f651c0762d0 0x7f651c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.462+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bcc005290 con 0x7f0bec0d0c60 2024-05-08T10:23:59.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.462+0000 7facd67fc640 1 -- 172.21.15.143:0/865326443 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7face00c1070 con 0x7facd80df770 2024-05-08T10:23:59.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.462+0000 7f653e276640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f651c0762d0 0x7f651c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.463+0000 7facd67fc640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7facc4076350 0x7facc4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.463+0000 7f0bd3fff640 1 -- 172.21.15.143:0/1901524865 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0be4005470 con 0x7f0bec0d0c60 2024-05-08T10:23:59.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.463+0000 7face5fbc640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7facc4076350 0x7facc4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.464+0000 7f0bd3fff640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0bd80762d0 0x7f0bd8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:23:59.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.464+0000 7face5fbc640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7facc4076350 0x7facc4078810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7facd000ab10 tx=0x7facd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.464+0000 7f653e276640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f651c0762d0 0x7f651c078790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65381529c0 tx=0x7f6528009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.464+0000 7f0bd3fff640 1 -- 172.21.15.143:0/1901524865 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0be4097450 con 0x7f0bec0d0c60 2024-05-08T10:23:59.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.464+0000 7f0beaffd640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0bd80762d0 0x7f0bd8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:23:59.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.465+0000 7f0beaffd640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0bd80762d0 0x7f0bd8078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0be00098a0 tx=0x7f0be002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:23:59.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.467+0000 7f0bd3fff640 1 -- 172.21.15.143:0/1901524865 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0be4060c80 con 0x7f0bec0d0c60 2024-05-08T10:23:59.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.467+0000 7f724dffb640 1 -- 172.21.15.143:0/2665707911 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7254061d90 con 0x7f7250048100 2024-05-08T10:23:59.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.468+0000 7f652effd640 1 -- 172.21.15.143:0/706511210 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f653407d950 con 0x7f653813ee60 2024-05-08T10:23:59.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.470+0000 7facd67fc640 1 -- 172.21.15.143:0/865326443 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7face00fa750 con 0x7facd80df770 2024-05-08T10:23:59.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.477+0000 7f652effd640 1 -- 172.21.15.143:0/706511210 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f653813e4a0 con 0x7f653813ee60 2024-05-08T10:23:59.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.487+0000 7facd67fc640 1 -- 172.21.15.143:0/865326443 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7face00fe4c0 con 0x7facd80df770 2024-05-08T10:23:59.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.830+0000 7fb753b46640 1 -- 172.21.15.143:0/2416903798 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb74400f3b0 con 0x7fb7440dfee0 2024-05-08T10:23:59.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.832+0000 7fb7427fc640 1 -- 172.21.15.143:0/2416903798 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb74400f3b0 con 0x7fb7440dfee0 2024-05-08T10:23:59.817 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2024-05-08T10:23:59.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.835+0000 7fb72ffff640 1 -- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb738076510 msgr2=0x7fb7380789d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.835+0000 7fb72ffff640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb738076510 0x7fb7380789d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb74400afe0 tx=0x7fb74c0ad000 comp rx=0 tx=0).stop 2024-05-08T10:23:59.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.835+0000 7fb72ffff640 1 -- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440dfee0 msgr2=0x7fb7440cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.835+0000 7fb72ffff640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440dfee0 0x7fb7440cfa20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb74800b480 tx=0x7fb74800b940 comp rx=0 tx=0).stop 2024-05-08T10:23:59.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.836+0000 7fb72ffff640 1 -- 172.21.15.143:0/2416903798 shutdown_connections 2024-05-08T10:23:59.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.836+0000 7fb72ffff640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb74404bc90 0x7fb7440d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.836+0000 7fb72ffff640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7440e40f0 0x7fb74404d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.836+0000 7fb72ffff640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb738076510 0x7fb7380789d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.836+0000 7fb72ffff640 1 --2- 172.21.15.143:0/2416903798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7440dfee0 0x7fb7440cfa20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.836+0000 7fb72ffff640 1 -- 172.21.15.143:0/2416903798 >> 172.21.15.143:0/2416903798 conn(0x7fb74401ef30 msgr2=0x7fb744008190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.836+0000 7fb72ffff640 1 -- 172.21.15.143:0/2416903798 shutdown_connections 2024-05-08T10:23:59.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.836+0000 7fb72ffff640 1 -- 172.21.15.143:0/2416903798 wait complete. 2024-05-08T10:23:59.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2024-05-08T10:23:59.838 DEBUG:teuthology.parallel:result is None 2024-05-08T10:23:59.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.865+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f47f404b560 con 0x7f47f4038180 2024-05-08T10:23:59.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.866+0000 7f47f8ff9640 1 -- 172.21.15.143:0/612706778 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47e8080d30 con 0x7f47f4038180 2024-05-08T10:23:59.851 INFO:teuthology.orchestra.run.smithi143.stdout:55834574853 2024-05-08T10:23:59.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f47e00763a0 msgr2=0x7f47e0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f47e00763a0 0x7f47e0078860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47f0006fd0 tx=0x7f47f0008040 comp rx=0 tx=0).stop 2024-05-08T10:23:59.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4038180 msgr2=0x7f47f40f4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4038180 0x7f47f40f4f20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e80046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 shutdown_connections 2024-05-08T10:23:59.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f47f404f290 0x7f47f40344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f47e00763a0 0x7f47e0078860 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f4038180 0x7f47f40f4f20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 --2- 172.21.15.143:0/612706778 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f47f4033990 0x7f47f40e2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 >> 172.21.15.143:0/612706778 conn(0x7f47f4009fb0 msgr2=0x7f47f4100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 shutdown_connections 2024-05-08T10:23:59.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.868+0000 7f48010d0640 1 -- 172.21.15.143:0/612706778 wait complete. 2024-05-08T10:23:59.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.871+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f996406a4b0 con 0x7f99640b4cb0 2024-05-08T10:23:59.857 INFO:teuthology.orchestra.run.smithi143.stdout:55834574856 2024-05-08T10:23:59.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.871+0000 7f995affd640 1 -- 172.21.15.143:0/1529457387 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f995c05ffa0 con 0x7f99640b4cb0 2024-05-08T10:23:59.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99480762d0 msgr2=0x7f9948078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99480762d0 0x7f9948078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9960012c50 tx=0x7f9960012be0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99640b4cb0 msgr2=0x7f99640cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99640b4cb0 0x7f99640cd900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c820 tx=0x7f995c00cce0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 shutdown_connections 2024-05-08T10:23:59.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99480762d0 0x7f9948078790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99640d1aa0 0x7f996415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f99640b4cb0 0x7f99640cd900 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c820 tx=0x7f995c00cce0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 --2- 172.21.15.143:0/1529457387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9964073ed0 0x7f9964151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 >> 172.21.15.143:0/1529457387 conn(0x7f996406c740 msgr2=0x7f99640adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 shutdown_connections 2024-05-08T10:23:59.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.875+0000 7f996c7da640 1 -- 172.21.15.143:0/1529457387 wait complete. 2024-05-08T10:23:59.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.2 2024-05-08T10:23:59.867 DEBUG:teuthology.parallel:result is None 2024-05-08T10:23:59.868 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.883+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f83a00057d0 con 0x7f83a004bdf0 2024-05-08T10:23:59.868 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.884+0000 7f839effd640 1 -- 172.21.15.143:0/4282116981 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8398060940 con 0x7f83a004bdf0 2024-05-08T10:23:59.869 INFO:teuthology.orchestra.run.smithi143.stdout:55834574855 2024-05-08T10:23:59.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f838c0763d0 msgr2=0x7f838c078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f838c0763d0 0x7f838c078890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f83a4033000 tx=0x7f83a4008030 comp rx=0 tx=0).stop 2024-05-08T10:23:59.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83a004bdf0 msgr2=0x7f83a0049720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83a004bdf0 0x7f83a0049720 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8398007310 tx=0x7f83980077d0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 shutdown_connections 2024-05-08T10:23:59.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f838c0763d0 0x7f838c078890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83a0049c60 0x7f83a017d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83a004bdf0 0x7f83a0049720 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 --2- 172.21.15.143:0/4282116981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83940039b0 0x7f83a004b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 >> 172.21.15.143:0/4282116981 conn(0x7f83a001ef30 msgr2=0x7f83a0054dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 shutdown_connections 2024-05-08T10:23:59.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.887+0000 7f83b07f7640 1 -- 172.21.15.143:0/4282116981 wait complete. 2024-05-08T10:23:59.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.3 2024-05-08T10:23:59.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.892+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0bcc005580 con 0x7f0bec0d0c60 2024-05-08T10:23:59.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.892+0000 7f0bd3fff640 1 -- 172.21.15.143:0/1901524865 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0be4060580 con 0x7f0bec0d0c60 2024-05-08T10:23:59.878 DEBUG:teuthology.parallel:result is None 2024-05-08T10:23:59.878 INFO:teuthology.orchestra.run.smithi143.stdout:55834574856 2024-05-08T10:23:59.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0bd80762d0 msgr2=0x7f0bd8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0bd80762d0 0x7f0bd8078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0be00098a0 tx=0x7f0be002e000 comp rx=0 tx=0).stop 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 msgr2=0x7f0bec1495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec1495b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c6c0 tx=0x7f0be400cb80 comp rx=0 tx=0).stop 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 shutdown_connections 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0bec15ce30 0x7f0bec0b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0bec0d0c60 0x7f0bec1495b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0bd80762d0 0x7f0bd8078790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 --2- 172.21.15.143:0/1901524865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bec0b4020 0x7f0bec09c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 >> 172.21.15.143:0/1901524865 conn(0x7f0bec0b6760 msgr2=0x7f0bec0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 shutdown_connections 2024-05-08T10:23:59.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.895+0000 7f0bf1a15640 1 -- 172.21.15.143:0/1901524865 wait complete. 2024-05-08T10:23:59.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2024-05-08T10:23:59.890 DEBUG:teuthology.parallel:result is None 2024-05-08T10:23:59.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.906+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f653815cd60 con 0x7f653813ee60 2024-05-08T10:23:59.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2024-05-08T10:23:59.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.907+0000 7f652effd640 1 -- 172.21.15.143:0/706511210 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65340816c0 con 0x7f653813ee60 2024-05-08T10:23:59.893 INFO:teuthology.orchestra.run.smithi143.stdout:55834574855 2024-05-08T10:23:59.893 DEBUG:teuthology.parallel:result is None 2024-05-08T10:23:59.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.907+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7238005850 con 0x7f7250048100 2024-05-08T10:23:59.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.907+0000 7f724dffb640 1 -- 172.21.15.143:0/2665707911 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7254061690 con 0x7f7250048100 2024-05-08T10:23:59.894 INFO:teuthology.orchestra.run.smithi143.stdout:55834574855 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f651c0762d0 msgr2=0x7f651c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f651c0762d0 0x7f651c078790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65381529c0 tx=0x7f6528009190 comp rx=0 tx=0).stop 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f653813ee60 msgr2=0x7f6538139bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f653813ee60 0x7f6538139bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6534031000 tx=0x7f65340046c0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 shutdown_connections 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f653815ff50 0x7f653815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f651c0762d0 0x7f651c078790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f653813ee60 0x7f6538139bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 --2- 172.21.15.143:0/706511210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65380d0bf0 0x7f653813a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 >> 172.21.15.143:0/706511210 conn(0x7f65380b3c80 msgr2=0x7f653815e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 shutdown_connections 2024-05-08T10:23:59.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.909+0000 7f653f278640 1 -- 172.21.15.143:0/706511210 wait complete. 2024-05-08T10:23:59.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f723c0762d0 msgr2=0x7f723c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f723c0762d0 0x7f723c078790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f725806ba40 tx=0x7f72580ab000 comp rx=0 tx=0).stop 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 msgr2=0x7f7250188c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 0x7f7250188c90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f725400d5f0 tx=0x7f725400dab0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 shutdown_connections 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7250054390 0x7f7250189510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f723c0762d0 0x7f723c078790 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7250048100 0x7f7250188c90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 --2- 172.21.15.143:0/2665707911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7250007460 0x7f72500e38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 >> 172.21.15.143:0/2665707911 conn(0x7f7250009fe0 msgr2=0x7f72500399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 shutdown_connections 2024-05-08T10:23:59.897 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.910+0000 7f725f2b0640 1 -- 172.21.15.143:0/2665707911 wait complete. 2024-05-08T10:23:59.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.914+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7facd8055150 con 0x7facd80df770 2024-05-08T10:23:59.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.914+0000 7facd67fc640 1 -- 172.21.15.143:0/865326443 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7face01027c0 con 0x7facd80df770 2024-05-08T10:23:59.899 INFO:teuthology.orchestra.run.smithi143.stdout:55834574854 2024-05-08T10:23:59.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7facc4076350 msgr2=0x7facc4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7facc4076350 0x7facc4078810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7facd000ab10 tx=0x7facd0008040 comp rx=0 tx=0).stop 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facd80df770 msgr2=0x7facd80de4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facd80df770 0x7facd80de4d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7face00520f0 tx=0x7face006b660 comp rx=0 tx=0).stop 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 shutdown_connections 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7facc4076350 0x7facc4078810 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facd80df770 0x7facd80de4d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facd8055d10 0x7facd8054660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 --2- 172.21.15.143:0/865326443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facd8006220 0x7facd8054120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 >> 172.21.15.143:0/865326443 conn(0x7facd801e6c0 msgr2=0x7facd803a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 shutdown_connections 2024-05-08T10:23:59.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:23:59.916+0000 7face6fbe640 1 -- 172.21.15.143:0/865326443 wait complete. 2024-05-08T10:23:59.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2024-05-08T10:23:59.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2024-05-08T10:23:59.909 DEBUG:teuthology.parallel:result is None 2024-05-08T10:23:59.909 DEBUG:teuthology.parallel:result is None 2024-05-08T10:23:59.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2024-05-08T10:23:59.913 DEBUG:teuthology.parallel:result is None 2024-05-08T10:23:59.914 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T10:23:59.914 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:00.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.067+0000 7f15b00da640 1 Processor -- start 2024-05-08T10:24:00.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.067+0000 7f15b00da640 1 -- start start 2024-05-08T10:24:00.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15b00da640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f15a80ae180 0x7f15a80b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15b00da640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a80b46e0 0x7f15a80afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15b00da640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15a8072f80 con 0x7f15a815c020 2024-05-08T10:24:00.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15b00da640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f15a80ae700 con 0x7f15a80ae180 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15b00da640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f15a8073290 con 0x7f15a80b46e0 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15ad675640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f15a80ae180 0x7f15a80b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15ad675640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f15a80ae180 0x7f15a80b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36332/0 (socket says 172.21.15.143:36332) 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15ade76640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f15a815c020 0x7f15a8073720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39106/0 (socket says 172.21.15.143:39106) 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15ad675640 1 -- 172.21.15.143:0/2947001293 learned_addr learned my addr 172.21.15.143:0/2947001293 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15ae677640 1 --2- 172.21.15.143:0/2947001293 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a80b46e0 0x7f15a80afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15ad675640 1 -- 172.21.15.143:0/2947001293 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a80b46e0 msgr2=0x7f15a80afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15ad675640 1 --2- 172.21.15.143:0/2947001293 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a80b46e0 0x7f15a80afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15ad675640 1 -- 172.21.15.143:0/2947001293 >> v1:172.21.15.143:6789/0 conn(0x7f15a815c020 legacy=0x7f15a8073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.068+0000 7f15ad675640 1 -- 172.21.15.143:0/2947001293 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a8074430 con 0x7f15a80ae180 2024-05-08T10:24:00.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.069+0000 7f15ad675640 1 --2- 172.21.15.143:0/2947001293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 0x7f15a80b41a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1598009870 tx=0x7f159802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec60113f7ca4f78 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:00.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.069+0000 7f15ace74640 1 -- 172.21.15.143:0/2947001293 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598037070 con 0x7f15a80ae180 2024-05-08T10:24:00.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.069+0000 7f15ace74640 1 -- 172.21.15.143:0/2947001293 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1598032440 con 0x7f15a80ae180 2024-05-08T10:24:00.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.069+0000 7f15ace74640 1 -- 172.21.15.143:0/2947001293 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598032810 con 0x7f15a80ae180 2024-05-08T10:24:00.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.069+0000 7f15b00da640 1 -- 172.21.15.143:0/2947001293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 msgr2=0x7f15a80b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.069+0000 7f15b00da640 1 --2- 172.21.15.143:0/2947001293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 0x7f15a80b41a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1598009870 tx=0x7f159802a130 comp rx=0 tx=0).stop 2024-05-08T10:24:00.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.070+0000 7f15b00da640 1 -- 172.21.15.143:0/2947001293 shutdown_connections 2024-05-08T10:24:00.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.070+0000 7f15b00da640 1 --2- 172.21.15.143:0/2947001293 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a80b46e0 0x7f15a80afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.070+0000 7f15b00da640 1 --2- 172.21.15.143:0/2947001293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 0x7f15a80b41a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.070+0000 7f15b00da640 1 -- 172.21.15.143:0/2947001293 >> 172.21.15.143:0/2947001293 conn(0x7f15a806c500 msgr2=0x7f15a806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:00.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.070+0000 7f15b00da640 1 -- 172.21.15.143:0/2947001293 shutdown_connections 2024-05-08T10:24:00.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.070+0000 7f15b00da640 1 -- 172.21.15.143:0/2947001293 wait complete. 2024-05-08T10:24:00.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.071+0000 7f15b00da640 1 Processor -- start 2024-05-08T10:24:00.057 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.071+0000 7f15b00da640 1 -- start start 2024-05-08T10:24:00.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.071+0000 7f15b00da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 0x7f15a814f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.071+0000 7f15b00da640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15a80b46e0 0x7f15a80b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.071+0000 7f15b00da640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a815c020 0x7f15a80cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.071+0000 7f15b00da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f15a80d0860 con 0x7f15a80ae180 2024-05-08T10:24:00.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.071+0000 7f15b00da640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f15a815c400 con 0x7f15a80b46e0 2024-05-08T10:24:00.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.071+0000 7f15b00da640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f15a80b4b70 con 0x7f15a815c020 2024-05-08T10:24:00.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ade76640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 0x7f15a814f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ade76640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 0x7f15a814f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36338/0 (socket says 172.21.15.143:36338) 2024-05-08T10:24:00.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ade76640 1 -- 172.21.15.143:0/3042467576 learned_addr learned my addr 172.21.15.143:0/3042467576 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ae677640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a815c020 0x7f15a80cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ad675640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15a80b46e0 0x7f15a80b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ade76640 1 -- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a815c020 msgr2=0x7f15a80cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ade76640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a815c020 0x7f15a80cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ade76640 1 -- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15a80b46e0 msgr2=0x7f15a80b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ade76640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15a80b46e0 0x7f15a80b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ade76640 1 -- 172.21.15.143:0/3042467576 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a814f9e0 con 0x7f15a80ae180 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ae677640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a815c020 0x7f15a80cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ad675640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15a80b46e0 0x7f15a80b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15ade76640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 0x7f15a814f4a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c7a0 tx=0x7f15a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f159e7fc640 1 -- 172.21.15.143:0/3042467576 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4017070 con 0x7f15a80ae180 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f159e7fc640 1 -- 172.21.15.143:0/3042467576 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a400a640 con 0x7f15a80ae180 2024-05-08T10:24:00.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a80b11b0 con 0x7f15a80ae180 2024-05-08T10:24:00.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f159e7fc640 1 -- 172.21.15.143:0/3042467576 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a400aa30 con 0x7f15a80ae180 2024-05-08T10:24:00.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.072+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a80b1770 con 0x7f15a80ae180 2024-05-08T10:24:00.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.073+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a806a550 con 0x7f15a80ae180 2024-05-08T10:24:00.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.074+0000 7f159e7fc640 1 -- 172.21.15.143:0/3042467576 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f15a401a070 con 0x7f15a80ae180 2024-05-08T10:24:00.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.074+0000 7f159e7fc640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f158c0762d0 0x7f158c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.074+0000 7f15ad675640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f158c0762d0 0x7f158c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.074+0000 7f159e7fc640 1 -- 172.21.15.143:0/3042467576 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f15a4096ad0 con 0x7f15a80ae180 2024-05-08T10:24:00.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.075+0000 7f15ad675640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f158c0762d0 0x7f158c078790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1598034000 tx=0x7f159802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:00.063 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.079+0000 7f159e7fc640 1 -- 172.21.15.143:0/3042467576 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f15a814f9e0 con 0x7f15a80ae180 2024-05-08T10:24:00.245 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.259+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15a8160450 con 0x7f158c0762d0 2024-05-08T10:24:00.250 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.265+0000 7f159e7fc640 1 -- 172.21.15.143:0/3042467576 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f15a8160450 con 0x7f158c0762d0 2024-05-08T10:24:00.254 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:00.255 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:00.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f158c0762d0 msgr2=0x7f158c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f158c0762d0 0x7f158c078790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1598034000 tx=0x7f159802e000 comp rx=0 tx=0).stop 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 msgr2=0x7f15a814f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 0x7f15a814f4a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c7a0 tx=0x7f15a400cc60 comp rx=0 tx=0).stop 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 shutdown_connections 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f15a815c020 0x7f15a80cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15a80b46e0 0x7f15a80b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f158c0762d0 0x7f158c078790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 --2- 172.21.15.143:0/3042467576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15a80ae180 0x7f15a814f4a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 >> 172.21.15.143:0/3042467576 conn(0x7f15a806c500 msgr2=0x7f15a815f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 shutdown_connections 2024-05-08T10:24:00.257 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.268+0000 7f15b00da640 1 -- 172.21.15.143:0/3042467576 wait complete. 2024-05-08T10:24:00.264 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T10:23:58.526543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001917"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071730+0000","last_change":"2024-05-08T10:23:48.455169+0000","last_active":"2024-05-08T10:23:50.071730+0000","last_peered":"2024-05-08T10:23:50.071730+0000","last_clean":"2024-05-08T10:23:50.071730+0000","last_became_active":"2024-05-08T10:23:48.454403+0000","last_became_peered":"2024-05-08T10:23:48.454403+0000","last_unstale":"2024-05-08T10:23:50.071730+0000","last_undegraded":"2024-05-08T10:23:50.071730+0000","last_fullsized":"2024-05-08T10:23:50.071730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:56.686042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439355+0000","last_change":"2024-05-08T10:23:48.442523+0000","last_active":"2024-05-08T10:23:49.439355+0000","last_peered":"2024-05-08T10:23:49.439355+0000","last_clean":"2024-05-08T10:23:49.439355+0000","last_became_active":"2024-05-08T10:23:48.442211+0000","last_became_peered":"2024-05-08T10:23:48.442211+0000","last_unstale":"2024-05-08T10:23:49.439355+0000","last_undegraded":"2024-05-08T10:23:49.439355+0000","last_fullsized":"2024-05-08T10:23:49.439355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071683+0000","last_change":"2024-05-08T10:23:48.438711+0000","last_active":"2024-05-08T10:23:50.071683+0000","last_peered":"2024-05-08T10:23:50.071683+0000","last_clean":"2024-05-08T10:23:50.071683+0000","last_became_active":"2024-05-08T10:23:48.438466+0000","last_became_peered":"2024-05-08T10:23:48.438466+0000","last_unstale":"2024-05-08T10:23:50.071683+0000","last_undegraded":"2024-05-08T10:23:50.071683+0000","last_fullsized":"2024-05-08T10:23:50.071683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071038+0000","last_change":"2024-05-08T10:23:48.452779+0000","last_active":"2024-05-08T10:23:50.071038+0000","last_peered":"2024-05-08T10:23:50.071038+0000","last_clean":"2024-05-08T10:23:50.071038+0000","last_became_active":"2024-05-08T10:23:48.452512+0000","last_became_peered":"2024-05-08T10:23:48.452512+0000","last_unstale":"2024-05-08T10:23:50.071038+0000","last_undegraded":"2024-05-08T10:23:50.071038+0000","last_fullsized":"2024-05-08T10:23:50.071038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:53:25.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071595+0000","last_change":"2024-05-08T10:23:48.444482+0000","last_active":"2024-05-08T10:23:50.071595+0000","last_peered":"2024-05-08T10:23:50.071595+0000","last_clean":"2024-05-08T10:23:50.071595+0000","last_became_active":"2024-05-08T10:23:48.444220+0000","last_became_peered":"2024-05-08T10:23:48.444220+0000","last_unstale":"2024-05-08T10:23:50.071595+0000","last_undegraded":"2024-05-08T10:23:50.071595+0000","last_fullsized":"2024-05-08T10:23:50.071595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:16.618080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070751+0000","last_change":"2024-05-08T10:23:48.452552+0000","last_active":"2024-05-08T10:23:50.070751+0000","last_peered":"2024-05-08T10:23:50.070751+0000","last_clean":"2024-05-08T10:23:50.070751+0000","last_became_active":"2024-05-08T10:23:48.452278+0000","last_became_peered":"2024-05-08T10:23:48.452278+0000","last_unstale":"2024-05-08T10:23:50.070751+0000","last_undegraded":"2024-05-08T10:23:50.070751+0000","last_fullsized":"2024-05-08T10:23:50.070751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:19.879536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071656+0000","last_change":"2024-05-08T10:23:48.449071+0000","last_active":"2024-05-08T10:23:50.071656+0000","last_peered":"2024-05-08T10:23:50.071656+0000","last_clean":"2024-05-08T10:23:50.071656+0000","last_became_active":"2024-05-08T10:23:48.448781+0000","last_became_peered":"2024-05-08T10:23:48.448781+0000","last_unstale":"2024-05-08T10:23:50.071656+0000","last_undegraded":"2024-05-08T10:23:50.071656+0000","last_fullsized":"2024-05-08T10:23:50.071656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:03.419955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070796+0000","last_change":"2024-05-08T10:23:48.450877+0000","last_active":"2024-05-08T10:23:50.070796+0000","last_peered":"2024-05-08T10:23:50.070796+0000","last_clean":"2024-05-08T10:23:50.070796+0000","last_became_active":"2024-05-08T10:23:48.450628+0000","last_became_peered":"2024-05-08T10:23:48.450628+0000","last_unstale":"2024-05-08T10:23:50.070796+0000","last_undegraded":"2024-05-08T10:23:50.070796+0000","last_fullsized":"2024-05-08T10:23:50.070796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071902+0000","last_change":"2024-05-08T10:23:48.455413+0000","last_active":"2024-05-08T10:23:50.071902+0000","last_peered":"2024-05-08T10:23:50.071902+0000","last_clean":"2024-05-08T10:23:50.071902+0000","last_became_active":"2024-05-08T10:23:48.454809+0000","last_became_peered":"2024-05-08T10:23:48.454809+0000","last_unstale":"2024-05-08T10:23:50.071902+0000","last_undegraded":"2024-05-08T10:23:50.071902+0000","last_fullsized":"2024-05-08T10:23:50.071902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:52.424060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070075+0000","last_change":"2024-05-08T10:23:48.452786+0000","last_active":"2024-05-08T10:23:50.070075+0000","last_peered":"2024-05-08T10:23:50.070075+0000","last_clean":"2024-05-08T10:23:50.070075+0000","last_became_active":"2024-05-08T10:23:48.452530+0000","last_became_peered":"2024-05-08T10:23:48.452530+0000","last_unstale":"2024-05-08T10:23:50.070075+0000","last_undegraded":"2024-05-08T10:23:50.070075+0000","last_fullsized":"2024-05-08T10:23:50.070075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069864+0000","last_change":"2024-05-08T10:23:48.452235+0000","last_active":"2024-05-08T10:23:50.069864+0000","last_peered":"2024-05-08T10:23:50.069864+0000","last_clean":"2024-05-08T10:23:50.069864+0000","last_became_active":"2024-05-08T10:23:48.451251+0000","last_became_peered":"2024-05-08T10:23:48.451251+0000","last_unstale":"2024-05-08T10:23:50.069864+0000","last_undegraded":"2024-05-08T10:23:50.069864+0000","last_fullsized":"2024-05-08T10:23:50.069864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440335+0000","last_change":"2024-05-08T10:23:48.445982+0000","last_active":"2024-05-08T10:23:49.440335+0000","last_peered":"2024-05-08T10:23:49.440335+0000","last_clean":"2024-05-08T10:23:49.440335+0000","last_became_active":"2024-05-08T10:23:48.445309+0000","last_became_peered":"2024-05-08T10:23:48.445309+0000","last_unstale":"2024-05-08T10:23:49.440335+0000","last_undegraded":"2024-05-08T10:23:49.440335+0000","last_fullsized":"2024-05-08T10:23:49.440335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:35.017589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071368+0000","last_change":"2024-05-08T10:23:48.446813+0000","last_active":"2024-05-08T10:23:50.071368+0000","last_peered":"2024-05-08T10:23:50.071368+0000","last_clean":"2024-05-08T10:23:50.071368+0000","last_became_active":"2024-05-08T10:23:48.446447+0000","last_became_peered":"2024-05-08T10:23:48.446447+0000","last_unstale":"2024-05-08T10:23:50.071368+0000","last_undegraded":"2024-05-08T10:23:50.071368+0000","last_fullsized":"2024-05-08T10:23:50.071368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:56.686042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071183+0000","last_change":"2024-05-08T10:23:48.449737+0000","last_active":"2024-05-08T10:23:50.071183+0000","last_peered":"2024-05-08T10:23:50.071183+0000","last_clean":"2024-05-08T10:23:50.071183+0000","last_became_active":"2024-05-08T10:23:48.449477+0000","last_became_peered":"2024-05-08T10:23:48.449477+0000","last_unstale":"2024-05-08T10:23:50.071183+0000","last_undegraded":"2024-05-08T10:23:50.071183+0000","last_fullsized":"2024-05-08T10:23:50.071183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:00.805521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439204+0000","last_change":"2024-05-08T10:23:48.441880+0000","last_active":"2024-05-08T10:23:49.439204+0000","last_peered":"2024-05-08T10:23:49.439204+0000","last_clean":"2024-05-08T10:23:49.439204+0000","last_became_active":"2024-05-08T10:23:48.441190+0000","last_became_peered":"2024-05-08T10:23:48.441190+0000","last_unstale":"2024-05-08T10:23:49.439204+0000","last_undegraded":"2024-05-08T10:23:49.439204+0000","last_fullsized":"2024-05-08T10:23:49.439204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070683+0000","last_change":"2024-05-08T10:23:48.451077+0000","last_active":"2024-05-08T10:23:50.070683+0000","last_peered":"2024-05-08T10:23:50.070683+0000","last_clean":"2024-05-08T10:23:50.070683+0000","last_became_active":"2024-05-08T10:23:48.450806+0000","last_became_peered":"2024-05-08T10:23:48.450806+0000","last_unstale":"2024-05-08T10:23:50.070683+0000","last_undegraded":"2024-05-08T10:23:50.070683+0000","last_fullsized":"2024-05-08T10:23:50.070683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071684+0000","last_change":"2024-05-08T10:23:48.456531+0000","last_active":"2024-05-08T10:23:50.071684+0000","last_peered":"2024-05-08T10:23:50.071684+0000","last_clean":"2024-05-08T10:23:50.071684+0000","last_became_active":"2024-05-08T10:23:48.456284+0000","last_became_peered":"2024-05-08T10:23:48.456284+0000","last_unstale":"2024-05-08T10:23:50.071684+0000","last_undegraded":"2024-05-08T10:23:50.071684+0000","last_fullsized":"2024-05-08T10:23:50.071684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:03.419955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439889+0000","last_change":"2024-05-08T10:23:48.442085+0000","last_active":"2024-05-08T10:23:49.439889+0000","last_peered":"2024-05-08T10:23:49.439889+0000","last_clean":"2024-05-08T10:23:49.439889+0000","last_became_active":"2024-05-08T10:23:48.441801+0000","last_became_peered":"2024-05-08T10:23:48.441801+0000","last_unstale":"2024-05-08T10:23:49.439889+0000","last_undegraded":"2024-05-08T10:23:49.439889+0000","last_fullsized":"2024-05-08T10:23:49.439889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:31.689147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072156+0000","last_change":"2024-05-08T10:23:48.446130+0000","last_active":"2024-05-08T10:23:50.072156+0000","last_peered":"2024-05-08T10:23:50.072156+0000","last_clean":"2024-05-08T10:23:50.072156+0000","last_became_active":"2024-05-08T10:23:48.445847+0000","last_became_peered":"2024-05-08T10:23:48.445847+0000","last_unstale":"2024-05-08T10:23:50.072156+0000","last_undegraded":"2024-05-08T10:23:50.072156+0000","last_fullsized":"2024-05-08T10:23:50.072156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:21.241922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069885+0000","last_change":"2024-05-08T10:23:48.444206+0000","last_active":"2024-05-08T10:23:50.069885+0000","last_peered":"2024-05-08T10:23:50.069885+0000","last_clean":"2024-05-08T10:23:50.069885+0000","last_became_active":"2024-05-08T10:23:48.443938+0000","last_became_peered":"2024-05-08T10:23:48.443938+0000","last_unstale":"2024-05-08T10:23:50.069885+0000","last_undegraded":"2024-05-08T10:23:50.069885+0000","last_fullsized":"2024-05-08T10:23:50.069885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071229+0000","last_change":"2024-05-08T10:23:48.455150+0000","last_active":"2024-05-08T10:23:50.071229+0000","last_peered":"2024-05-08T10:23:50.071229+0000","last_clean":"2024-05-08T10:23:50.071229+0000","last_became_active":"2024-05-08T10:23:48.454911+0000","last_became_peered":"2024-05-08T10:23:48.454911+0000","last_unstale":"2024-05-08T10:23:50.071229+0000","last_undegraded":"2024-05-08T10:23:50.071229+0000","last_fullsized":"2024-05-08T10:23:50.071229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:50:17.413158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070974+0000","last_change":"2024-05-08T10:23:48.455822+0000","last_active":"2024-05-08T10:23:50.070974+0000","last_peered":"2024-05-08T10:23:50.070974+0000","last_clean":"2024-05-08T10:23:50.070974+0000","last_became_active":"2024-05-08T10:23:48.455339+0000","last_became_peered":"2024-05-08T10:23:48.455339+0000","last_unstale":"2024-05-08T10:23:50.070974+0000","last_undegraded":"2024-05-08T10:23:50.070974+0000","last_fullsized":"2024-05-08T10:23:50.070974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:17.618922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070826+0000","last_change":"2024-05-08T10:23:48.436289+0000","last_active":"2024-05-08T10:23:50.070826+0000","last_peered":"2024-05-08T10:23:50.070826+0000","last_clean":"2024-05-08T10:23:50.070826+0000","last_became_active":"2024-05-08T10:23:48.436039+0000","last_became_peered":"2024-05-08T10:23:48.436039+0000","last_unstale":"2024-05-08T10:23:50.070826+0000","last_undegraded":"2024-05-08T10:23:50.070826+0000","last_fullsized":"2024-05-08T10:23:50.070826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071248+0000","last_change":"2024-05-08T10:23:48.450416+0000","last_active":"2024-05-08T10:23:50.071248+0000","last_peered":"2024-05-08T10:23:50.071248+0000","last_clean":"2024-05-08T10:23:50.071248+0000","last_became_active":"2024-05-08T10:23:48.450131+0000","last_became_peered":"2024-05-08T10:23:48.450131+0000","last_unstale":"2024-05-08T10:23:50.071248+0000","last_undegraded":"2024-05-08T10:23:50.071248+0000","last_fullsized":"2024-05-08T10:23:50.071248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:44:13.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071001+0000","last_change":"2024-05-08T10:23:48.437015+0000","last_active":"2024-05-08T10:23:50.071001+0000","last_peered":"2024-05-08T10:23:50.071001+0000","last_clean":"2024-05-08T10:23:50.071001+0000","last_became_active":"2024-05-08T10:23:48.436779+0000","last_became_peered":"2024-05-08T10:23:48.436779+0000","last_unstale":"2024-05-08T10:23:50.071001+0000","last_undegraded":"2024-05-08T10:23:50.071001+0000","last_fullsized":"2024-05-08T10:23:50.071001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070202+0000","last_change":"2024-05-08T10:23:48.443798+0000","last_active":"2024-05-08T10:23:50.070202+0000","last_peered":"2024-05-08T10:23:50.070202+0000","last_clean":"2024-05-08T10:23:50.070202+0000","last_became_active":"2024-05-08T10:23:48.442703+0000","last_became_peered":"2024-05-08T10:23:48.442703+0000","last_unstale":"2024-05-08T10:23:50.070202+0000","last_undegraded":"2024-05-08T10:23:50.070202+0000","last_fullsized":"2024-05-08T10:23:50.070202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:19.879536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439323+0000","last_change":"2024-05-08T10:23:48.448757+0000","last_active":"2024-05-08T10:23:49.439323+0000","last_peered":"2024-05-08T10:23:49.439323+0000","last_clean":"2024-05-08T10:23:49.439323+0000","last_became_active":"2024-05-08T10:23:48.445205+0000","last_became_peered":"2024-05-08T10:23:48.445205+0000","last_unstale":"2024-05-08T10:23:49.439323+0000","last_undegraded":"2024-05-08T10:23:49.439323+0000","last_fullsized":"2024-05-08T10:23:49.439323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071548+0000","last_change":"2024-05-08T10:23:48.436978+0000","last_active":"2024-05-08T10:23:50.071548+0000","last_peered":"2024-05-08T10:23:50.071548+0000","last_clean":"2024-05-08T10:23:50.071548+0000","last_became_active":"2024-05-08T10:23:48.436738+0000","last_became_peered":"2024-05-08T10:23:48.436738+0000","last_unstale":"2024-05-08T10:23:50.071548+0000","last_undegraded":"2024-05-08T10:23:50.071548+0000","last_fullsized":"2024-05-08T10:23:50.071548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:44:13.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071465+0000","last_change":"2024-05-08T10:23:48.443335+0000","last_active":"2024-05-08T10:23:50.071465+0000","last_peered":"2024-05-08T10:23:50.071465+0000","last_clean":"2024-05-08T10:23:50.071465+0000","last_became_active":"2024-05-08T10:23:48.443060+0000","last_became_peered":"2024-05-08T10:23:48.443060+0000","last_unstale":"2024-05-08T10:23:50.071465+0000","last_undegraded":"2024-05-08T10:23:50.071465+0000","last_fullsized":"2024-05-08T10:23:50.071465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071030+0000","last_change":"2024-05-08T10:23:48.450521+0000","last_active":"2024-05-08T10:23:50.071030+0000","last_peered":"2024-05-08T10:23:50.071030+0000","last_clean":"2024-05-08T10:23:50.071030+0000","last_became_active":"2024-05-08T10:23:48.450218+0000","last_became_peered":"2024-05-08T10:23:48.450218+0000","last_unstale":"2024-05-08T10:23:50.071030+0000","last_undegraded":"2024-05-08T10:23:50.071030+0000","last_fullsized":"2024-05-08T10:23:50.071030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:56.686042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439839+0000","last_change":"2024-05-08T10:23:48.451961+0000","last_active":"2024-05-08T10:23:49.439839+0000","last_peered":"2024-05-08T10:23:49.439839+0000","last_clean":"2024-05-08T10:23:49.439839+0000","last_became_active":"2024-05-08T10:23:48.451678+0000","last_became_peered":"2024-05-08T10:23:48.451678+0000","last_unstale":"2024-05-08T10:23:49.439839+0000","last_undegraded":"2024-05-08T10:23:49.439839+0000","last_fullsized":"2024-05-08T10:23:49.439839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:09.213193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069663+0000","last_change":"2024-05-08T10:23:48.443980+0000","last_active":"2024-05-08T10:23:50.069663+0000","last_peered":"2024-05-08T10:23:50.069663+0000","last_clean":"2024-05-08T10:23:50.069663+0000","last_became_active":"2024-05-08T10:23:48.443469+0000","last_became_peered":"2024-05-08T10:23:48.443469+0000","last_unstale":"2024-05-08T10:23:50.069663+0000","last_undegraded":"2024-05-08T10:23:50.069663+0000","last_fullsized":"2024-05-08T10:23:50.069663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440644+0000","last_change":"2024-05-08T10:23:48.442083+0000","last_active":"2024-05-08T10:23:49.440644+0000","last_peered":"2024-05-08T10:23:49.440644+0000","last_clean":"2024-05-08T10:23:49.440644+0000","last_became_active":"2024-05-08T10:23:48.441800+0000","last_became_peered":"2024-05-08T10:23:48.441800+0000","last_unstale":"2024-05-08T10:23:49.440644+0000","last_undegraded":"2024-05-08T10:23:49.440644+0000","last_fullsized":"2024-05-08T10:23:49.440644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:09.213193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071590+0000","last_change":"2024-05-08T10:23:47.440565+0000","last_active":"2024-05-08T10:23:50.071590+0000","last_peered":"2024-05-08T10:23:50.071590+0000","last_clean":"2024-05-08T10:23:50.071590+0000","last_became_active":"2024-05-08T10:23:47.440296+0000","last_became_peered":"2024-05-08T10:23:47.440296+0000","last_unstale":"2024-05-08T10:23:50.071590+0000","last_undegraded":"2024-05-08T10:23:50.071590+0000","last_fullsized":"2024-05-08T10:23:50.071590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071386+0000","last_change":"2024-05-08T10:23:48.448280+0000","last_active":"2024-05-08T10:23:50.071386+0000","last_peered":"2024-05-08T10:23:50.071386+0000","last_clean":"2024-05-08T10:23:50.071386+0000","last_became_active":"2024-05-08T10:23:48.446906+0000","last_became_peered":"2024-05-08T10:23:48.446906+0000","last_unstale":"2024-05-08T10:23:50.071386+0000","last_undegraded":"2024-05-08T10:23:50.071386+0000","last_fullsized":"2024-05-08T10:23:50.071386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:45.698206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069700+0000","last_change":"2024-05-08T10:23:47.432111+0000","last_active":"2024-05-08T10:23:50.069700+0000","last_peered":"2024-05-08T10:23:50.069700+0000","last_clean":"2024-05-08T10:23:50.069700+0000","last_became_active":"2024-05-08T10:23:47.430756+0000","last_became_peered":"2024-05-08T10:23:47.430756+0000","last_unstale":"2024-05-08T10:23:50.069700+0000","last_undegraded":"2024-05-08T10:23:50.069700+0000","last_fullsized":"2024-05-08T10:23:50.069700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070922+0000","last_change":"2024-05-08T10:23:47.431893+0000","last_active":"2024-05-08T10:23:50.070922+0000","last_peered":"2024-05-08T10:23:50.070922+0000","last_clean":"2024-05-08T10:23:50.070922+0000","last_became_active":"2024-05-08T10:23:47.431613+0000","last_became_peered":"2024-05-08T10:23:47.431613+0000","last_unstale":"2024-05-08T10:23:50.070922+0000","last_undegraded":"2024-05-08T10:23:50.070922+0000","last_fullsized":"2024-05-08T10:23:50.070922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070872+0000","last_change":"2024-05-08T10:23:48.440041+0000","last_active":"2024-05-08T10:23:50.070872+0000","last_peered":"2024-05-08T10:23:50.070872+0000","last_clean":"2024-05-08T10:23:50.070872+0000","last_became_active":"2024-05-08T10:23:48.439778+0000","last_became_peered":"2024-05-08T10:23:48.439778+0000","last_unstale":"2024-05-08T10:23:50.070872+0000","last_undegraded":"2024-05-08T10:23:50.070872+0000","last_fullsized":"2024-05-08T10:23:50.070872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070865+0000","last_change":"2024-05-08T10:23:47.436762+0000","last_active":"2024-05-08T10:23:50.070865+0000","last_peered":"2024-05-08T10:23:50.070865+0000","last_clean":"2024-05-08T10:23:50.070865+0000","last_became_active":"2024-05-08T10:23:47.436442+0000","last_became_peered":"2024-05-08T10:23:47.436442+0000","last_unstale":"2024-05-08T10:23:50.070865+0000","last_undegraded":"2024-05-08T10:23:50.070865+0000","last_fullsized":"2024-05-08T10:23:50.070865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439049+0000","last_change":"2024-05-08T10:23:48.442152+0000","last_active":"2024-05-08T10:23:49.439049+0000","last_peered":"2024-05-08T10:23:49.439049+0000","last_clean":"2024-05-08T10:23:49.439049+0000","last_became_active":"2024-05-08T10:23:48.441502+0000","last_became_peered":"2024-05-08T10:23:48.441502+0000","last_unstale":"2024-05-08T10:23:49.439049+0000","last_undegraded":"2024-05-08T10:23:49.439049+0000","last_fullsized":"2024-05-08T10:23:49.439049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069890+0000","last_change":"2024-05-08T10:23:47.439183+0000","last_active":"2024-05-08T10:23:50.069890+0000","last_peered":"2024-05-08T10:23:50.069890+0000","last_clean":"2024-05-08T10:23:50.069890+0000","last_became_active":"2024-05-08T10:23:47.438842+0000","last_became_peered":"2024-05-08T10:23:47.438842+0000","last_unstale":"2024-05-08T10:23:50.069890+0000","last_undegraded":"2024-05-08T10:23:50.069890+0000","last_fullsized":"2024-05-08T10:23:50.069890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071287+0000","last_change":"2024-05-08T10:23:48.455537+0000","last_active":"2024-05-08T10:23:50.071287+0000","last_peered":"2024-05-08T10:23:50.071287+0000","last_clean":"2024-05-08T10:23:50.071287+0000","last_became_active":"2024-05-08T10:23:48.455276+0000","last_became_peered":"2024-05-08T10:23:48.455276+0000","last_unstale":"2024-05-08T10:23:50.071287+0000","last_undegraded":"2024-05-08T10:23:50.071287+0000","last_fullsized":"2024-05-08T10:23:50.071287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:31.821509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071153+0000","last_change":"2024-05-08T10:23:47.442360+0000","last_active":"2024-05-08T10:23:50.071153+0000","last_peered":"2024-05-08T10:23:50.071153+0000","last_clean":"2024-05-08T10:23:50.071153+0000","last_became_active":"2024-05-08T10:23:47.442107+0000","last_became_peered":"2024-05-08T10:23:47.442107+0000","last_unstale":"2024-05-08T10:23:50.071153+0000","last_undegraded":"2024-05-08T10:23:50.071153+0000","last_fullsized":"2024-05-08T10:23:50.071153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071781+0000","last_change":"2024-05-08T10:23:48.451904+0000","last_active":"2024-05-08T10:23:50.071781+0000","last_peered":"2024-05-08T10:23:50.071781+0000","last_clean":"2024-05-08T10:23:50.071781+0000","last_became_active":"2024-05-08T10:23:48.451622+0000","last_became_peered":"2024-05-08T10:23:48.451622+0000","last_unstale":"2024-05-08T10:23:50.071781+0000","last_undegraded":"2024-05-08T10:23:50.071781+0000","last_fullsized":"2024-05-08T10:23:50.071781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439437+0000","last_change":"2024-05-08T10:23:47.438561+0000","last_active":"2024-05-08T10:23:49.439437+0000","last_peered":"2024-05-08T10:23:49.439437+0000","last_clean":"2024-05-08T10:23:49.439437+0000","last_became_active":"2024-05-08T10:23:47.437710+0000","last_became_peered":"2024-05-08T10:23:47.437710+0000","last_unstale":"2024-05-08T10:23:49.439437+0000","last_undegraded":"2024-05-08T10:23:49.439437+0000","last_fullsized":"2024-05-08T10:23:49.439437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440449+0000","last_change":"2024-05-08T10:23:48.442317+0000","last_active":"2024-05-08T10:23:49.440449+0000","last_peered":"2024-05-08T10:23:49.440449+0000","last_clean":"2024-05-08T10:23:49.440449+0000","last_became_active":"2024-05-08T10:23:48.440195+0000","last_became_peered":"2024-05-08T10:23:48.440195+0000","last_unstale":"2024-05-08T10:23:49.440449+0000","last_undegraded":"2024-05-08T10:23:49.440449+0000","last_fullsized":"2024-05-08T10:23:49.440449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:04.879915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069882+0000","last_change":"2024-05-08T10:23:47.436584+0000","last_active":"2024-05-08T10:23:50.069882+0000","last_peered":"2024-05-08T10:23:50.069882+0000","last_clean":"2024-05-08T10:23:50.069882+0000","last_became_active":"2024-05-08T10:23:47.436126+0000","last_became_peered":"2024-05-08T10:23:47.436126+0000","last_unstale":"2024-05-08T10:23:50.069882+0000","last_undegraded":"2024-05-08T10:23:50.069882+0000","last_fullsized":"2024-05-08T10:23:50.069882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071655+0000","last_change":"2024-05-08T10:23:48.448534+0000","last_active":"2024-05-08T10:23:50.071655+0000","last_peered":"2024-05-08T10:23:50.071655+0000","last_clean":"2024-05-08T10:23:50.071655+0000","last_became_active":"2024-05-08T10:23:48.448301+0000","last_became_peered":"2024-05-08T10:23:48.448301+0000","last_unstale":"2024-05-08T10:23:50.071655+0000","last_undegraded":"2024-05-08T10:23:50.071655+0000","last_fullsized":"2024-05-08T10:23:50.071655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:17.618922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071724+0000","last_change":"2024-05-08T10:23:47.435055+0000","last_active":"2024-05-08T10:23:50.071724+0000","last_peered":"2024-05-08T10:23:50.071724+0000","last_clean":"2024-05-08T10:23:50.071724+0000","last_became_active":"2024-05-08T10:23:47.434642+0000","last_became_peered":"2024-05-08T10:23:47.434642+0000","last_unstale":"2024-05-08T10:23:50.071724+0000","last_undegraded":"2024-05-08T10:23:50.071724+0000","last_fullsized":"2024-05-08T10:23:50.071724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071520+0000","last_change":"2024-05-08T10:23:48.443473+0000","last_active":"2024-05-08T10:23:50.071520+0000","last_peered":"2024-05-08T10:23:50.071520+0000","last_clean":"2024-05-08T10:23:50.071520+0000","last_became_active":"2024-05-08T10:23:48.443180+0000","last_became_peered":"2024-05-08T10:23:48.443180+0000","last_unstale":"2024-05-08T10:23:50.071520+0000","last_undegraded":"2024-05-08T10:23:50.071520+0000","last_fullsized":"2024-05-08T10:23:50.071520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071108+0000","last_change":"2024-05-08T10:23:47.437417+0000","last_active":"2024-05-08T10:23:50.071108+0000","last_peered":"2024-05-08T10:23:50.071108+0000","last_clean":"2024-05-08T10:23:50.071108+0000","last_became_active":"2024-05-08T10:23:47.437129+0000","last_became_peered":"2024-05-08T10:23:47.437129+0000","last_unstale":"2024-05-08T10:23:50.071108+0000","last_undegraded":"2024-05-08T10:23:50.071108+0000","last_fullsized":"2024-05-08T10:23:50.071108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071661+0000","last_change":"2024-05-08T10:23:48.441913+0000","last_active":"2024-05-08T10:23:50.071661+0000","last_peered":"2024-05-08T10:23:50.071661+0000","last_clean":"2024-05-08T10:23:50.071661+0000","last_became_active":"2024-05-08T10:23:48.439621+0000","last_became_peered":"2024-05-08T10:23:48.439621+0000","last_unstale":"2024-05-08T10:23:50.071661+0000","last_undegraded":"2024-05-08T10:23:50.071661+0000","last_fullsized":"2024-05-08T10:23:50.071661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:44:13.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069650+0000","last_change":"2024-05-08T10:23:47.432460+0000","last_active":"2024-05-08T10:23:50.069650+0000","last_peered":"2024-05-08T10:23:50.069650+0000","last_clean":"2024-05-08T10:23:50.069650+0000","last_became_active":"2024-05-08T10:23:47.432156+0000","last_became_peered":"2024-05-08T10:23:47.432156+0000","last_unstale":"2024-05-08T10:23:50.069650+0000","last_undegraded":"2024-05-08T10:23:50.069650+0000","last_fullsized":"2024-05-08T10:23:50.069650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069545+0000","last_change":"2024-05-08T10:23:48.443752+0000","last_active":"2024-05-08T10:23:50.069545+0000","last_peered":"2024-05-08T10:23:50.069545+0000","last_clean":"2024-05-08T10:23:50.069545+0000","last_became_active":"2024-05-08T10:23:48.443133+0000","last_became_peered":"2024-05-08T10:23:48.443133+0000","last_unstale":"2024-05-08T10:23:50.069545+0000","last_undegraded":"2024-05-08T10:23:50.069545+0000","last_fullsized":"2024-05-08T10:23:50.069545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439625+0000","last_change":"2024-05-08T10:23:47.439271+0000","last_active":"2024-05-08T10:23:49.439625+0000","last_peered":"2024-05-08T10:23:49.439625+0000","last_clean":"2024-05-08T10:23:49.439625+0000","last_became_active":"2024-05-08T10:23:47.438952+0000","last_became_peered":"2024-05-08T10:23:47.438952+0000","last_unstale":"2024-05-08T10:23:49.439625+0000","last_undegraded":"2024-05-08T10:23:49.439625+0000","last_fullsized":"2024-05-08T10:23:49.439625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071730+0000","last_change":"2024-05-08T10:23:48.450406+0000","last_active":"2024-05-08T10:23:50.071730+0000","last_peered":"2024-05-08T10:23:50.071730+0000","last_clean":"2024-05-08T10:23:50.071730+0000","last_became_active":"2024-05-08T10:23:48.450137+0000","last_became_peered":"2024-05-08T10:23:48.450137+0000","last_unstale":"2024-05-08T10:23:50.071730+0000","last_undegraded":"2024-05-08T10:23:50.071730+0000","last_fullsized":"2024-05-08T10:23:50.071730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:53:25.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440561+0000","last_change":"2024-05-08T10:23:47.436054+0000","last_active":"2024-05-08T10:23:49.440561+0000","last_peered":"2024-05-08T10:23:49.440561+0000","last_clean":"2024-05-08T10:23:49.440561+0000","last_became_active":"2024-05-08T10:23:47.435777+0000","last_became_peered":"2024-05-08T10:23:47.435777+0000","last_unstale":"2024-05-08T10:23:49.440561+0000","last_undegraded":"2024-05-08T10:23:49.440561+0000","last_fullsized":"2024-05-08T10:23:49.440561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071790+0000","last_change":"2024-05-08T10:23:48.439230+0000","last_active":"2024-05-08T10:23:50.071790+0000","last_peered":"2024-05-08T10:23:50.071790+0000","last_clean":"2024-05-08T10:23:50.071790+0000","last_became_active":"2024-05-08T10:23:48.438944+0000","last_became_peered":"2024-05-08T10:23:48.438944+0000","last_unstale":"2024-05-08T10:23:50.071790+0000","last_undegraded":"2024-05-08T10:23:50.071790+0000","last_fullsized":"2024-05-08T10:23:50.071790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.646809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439834+0000","last_change":"2024-05-08T10:23:47.428146+0000","last_active":"2024-05-08T10:23:49.439834+0000","last_peered":"2024-05-08T10:23:49.439834+0000","last_clean":"2024-05-08T10:23:49.439834+0000","last_became_active":"2024-05-08T10:23:47.427826+0000","last_became_peered":"2024-05-08T10:23:47.427826+0000","last_unstale":"2024-05-08T10:23:49.439834+0000","last_undegraded":"2024-05-08T10:23:49.439834+0000","last_fullsized":"2024-05-08T10:23:49.439834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072114+0000","last_change":"2024-05-08T10:23:48.456216+0000","last_active":"2024-05-08T10:23:50.072114+0000","last_peered":"2024-05-08T10:23:50.072114+0000","last_clean":"2024-05-08T10:23:50.072114+0000","last_became_active":"2024-05-08T10:23:48.455943+0000","last_became_peered":"2024-05-08T10:23:48.455943+0000","last_unstale":"2024-05-08T10:23:50.072114+0000","last_undegraded":"2024-05-08T10:23:50.072114+0000","last_fullsized":"2024-05-08T10:23:50.072114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:58.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439419+0000","last_change":"2024-05-08T10:23:47.438474+0000","last_active":"2024-05-08T10:23:49.439419+0000","last_peered":"2024-05-08T10:23:49.439419+0000","last_clean":"2024-05-08T10:23:49.439419+0000","last_became_active":"2024-05-08T10:23:47.437999+0000","last_became_peered":"2024-05-08T10:23:47.437999+0000","last_unstale":"2024-05-08T10:23:49.439419+0000","last_undegraded":"2024-05-08T10:23:49.439419+0000","last_fullsized":"2024-05-08T10:23:49.439419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:03.877856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071428+0000","last_change":"2024-05-08T10:23:48.452268+0000","last_active":"2024-05-08T10:23:50.071428+0000","last_peered":"2024-05-08T10:23:50.071428+0000","last_clean":"2024-05-08T10:23:50.071428+0000","last_became_active":"2024-05-08T10:23:48.451967+0000","last_became_peered":"2024-05-08T10:23:48.451967+0000","last_unstale":"2024-05-08T10:23:50.071428+0000","last_undegraded":"2024-05-08T10:23:50.071428+0000","last_fullsized":"2024-05-08T10:23:50.071428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:52.424060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439314+0000","last_change":"2024-05-08T10:23:47.437314+0000","last_active":"2024-05-08T10:23:49.439314+0000","last_peered":"2024-05-08T10:23:49.439314+0000","last_clean":"2024-05-08T10:23:49.439314+0000","last_became_active":"2024-05-08T10:23:47.436966+0000","last_became_peered":"2024-05-08T10:23:47.436966+0000","last_unstale":"2024-05-08T10:23:49.439314+0000","last_undegraded":"2024-05-08T10:23:49.439314+0000","last_fullsized":"2024-05-08T10:23:49.439314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071837+0000","last_change":"2024-05-08T10:23:48.452071+0000","last_active":"2024-05-08T10:23:50.071837+0000","last_peered":"2024-05-08T10:23:50.071837+0000","last_clean":"2024-05-08T10:23:50.071837+0000","last_became_active":"2024-05-08T10:23:48.451744+0000","last_became_peered":"2024-05-08T10:23:48.451744+0000","last_unstale":"2024-05-08T10:23:50.071837+0000","last_undegraded":"2024-05-08T10:23:50.071837+0000","last_fullsized":"2024-05-08T10:23:50.071837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:31.821509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071896+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:23:50.071896+0000","last_peered":"2024-05-08T10:23:50.071896+0000","last_clean":"2024-05-08T10:23:50.071896+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:23:50.071896+0000","last_undegraded":"2024-05-08T10:23:50.071896+0000","last_fullsized":"2024-05-08T10:23:50.071896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070816+0000","last_change":"2024-05-08T10:23:47.437924+0000","last_active":"2024-05-08T10:23:50.070816+0000","last_peered":"2024-05-08T10:23:50.070816+0000","last_clean":"2024-05-08T10:23:50.070816+0000","last_became_active":"2024-05-08T10:23:47.437630+0000","last_became_peered":"2024-05-08T10:23:47.437630+0000","last_unstale":"2024-05-08T10:23:50.070816+0000","last_undegraded":"2024-05-08T10:23:50.070816+0000","last_fullsized":"2024-05-08T10:23:50.070816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071143+0000","last_change":"2024-05-08T10:23:48.454035+0000","last_active":"2024-05-08T10:23:50.071143+0000","last_peered":"2024-05-08T10:23:50.071143+0000","last_clean":"2024-05-08T10:23:50.071143+0000","last_became_active":"2024-05-08T10:23:48.453770+0000","last_became_peered":"2024-05-08T10:23:48.453770+0000","last_unstale":"2024-05-08T10:23:50.071143+0000","last_undegraded":"2024-05-08T10:23:50.071143+0000","last_fullsized":"2024-05-08T10:23:50.071143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:19.879536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071396+0000","last_change":"2024-05-08T10:23:47.442183+0000","last_active":"2024-05-08T10:23:50.071396+0000","last_peered":"2024-05-08T10:23:50.071396+0000","last_clean":"2024-05-08T10:23:50.071396+0000","last_became_active":"2024-05-08T10:23:47.441485+0000","last_became_peered":"2024-05-08T10:23:47.441485+0000","last_unstale":"2024-05-08T10:23:50.071396+0000","last_undegraded":"2024-05-08T10:23:50.071396+0000","last_fullsized":"2024-05-08T10:23:50.071396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071720+0000","last_change":"2024-05-08T10:23:48.436512+0000","last_active":"2024-05-08T10:23:50.071720+0000","last_peered":"2024-05-08T10:23:50.071720+0000","last_clean":"2024-05-08T10:23:50.071720+0000","last_became_active":"2024-05-08T10:23:48.436244+0000","last_became_peered":"2024-05-08T10:23:48.436244+0000","last_unstale":"2024-05-08T10:23:50.071720+0000","last_undegraded":"2024-05-08T10:23:50.071720+0000","last_fullsized":"2024-05-08T10:23:50.071720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439825+0000","last_change":"2024-05-08T10:23:47.426677+0000","last_active":"2024-05-08T10:23:49.439825+0000","last_peered":"2024-05-08T10:23:49.439825+0000","last_clean":"2024-05-08T10:23:49.439825+0000","last_became_active":"2024-05-08T10:23:47.426406+0000","last_became_peered":"2024-05-08T10:23:47.426406+0000","last_unstale":"2024-05-08T10:23:49.439825+0000","last_undegraded":"2024-05-08T10:23:49.439825+0000","last_fullsized":"2024-05-08T10:23:49.439825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439093+0000","last_change":"2024-05-08T10:23:48.442557+0000","last_active":"2024-05-08T10:23:49.439093+0000","last_peered":"2024-05-08T10:23:49.439093+0000","last_clean":"2024-05-08T10:23:49.439093+0000","last_became_active":"2024-05-08T10:23:48.442172+0000","last_became_peered":"2024-05-08T10:23:48.442172+0000","last_unstale":"2024-05-08T10:23:49.439093+0000","last_undegraded":"2024-05-08T10:23:49.439093+0000","last_fullsized":"2024-05-08T10:23:49.439093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071141+0000","last_change":"2024-05-08T10:23:47.440567+0000","last_active":"2024-05-08T10:23:50.071141+0000","last_peered":"2024-05-08T10:23:50.071141+0000","last_clean":"2024-05-08T10:23:50.071141+0000","last_became_active":"2024-05-08T10:23:47.440075+0000","last_became_peered":"2024-05-08T10:23:47.440075+0000","last_unstale":"2024-05-08T10:23:50.071141+0000","last_undegraded":"2024-05-08T10:23:50.071141+0000","last_fullsized":"2024-05-08T10:23:50.071141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440323+0000","last_change":"2024-05-08T10:23:48.440957+0000","last_active":"2024-05-08T10:23:49.440323+0000","last_peered":"2024-05-08T10:23:49.440323+0000","last_clean":"2024-05-08T10:23:49.440323+0000","last_became_active":"2024-05-08T10:23:48.440668+0000","last_became_peered":"2024-05-08T10:23:48.440668+0000","last_unstale":"2024-05-08T10:23:49.440323+0000","last_undegraded":"2024-05-08T10:23:49.440323+0000","last_fullsized":"2024-05-08T10:23:49.440323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:42.025883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439618+0000","last_change":"2024-05-08T10:23:47.439238+0000","last_active":"2024-05-08T10:23:49.439618+0000","last_peered":"2024-05-08T10:23:49.439618+0000","last_clean":"2024-05-08T10:23:49.439618+0000","last_became_active":"2024-05-08T10:23:47.438965+0000","last_became_peered":"2024-05-08T10:23:47.438965+0000","last_unstale":"2024-05-08T10:23:49.439618+0000","last_undegraded":"2024-05-08T10:23:49.439618+0000","last_fullsized":"2024-05-08T10:23:49.439618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:08.211133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071825+0000","last_change":"2024-05-08T10:23:48.449865+0000","last_active":"2024-05-08T10:23:50.071825+0000","last_peered":"2024-05-08T10:23:50.071825+0000","last_clean":"2024-05-08T10:23:50.071825+0000","last_became_active":"2024-05-08T10:23:48.449534+0000","last_became_peered":"2024-05-08T10:23:48.449534+0000","last_unstale":"2024-05-08T10:23:50.071825+0000","last_undegraded":"2024-05-08T10:23:50.071825+0000","last_fullsized":"2024-05-08T10:23:50.071825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:58.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072152+0000","last_change":"2024-05-08T10:23:47.443886+0000","last_active":"2024-05-08T10:23:50.072152+0000","last_peered":"2024-05-08T10:23:50.072152+0000","last_clean":"2024-05-08T10:23:50.072152+0000","last_became_active":"2024-05-08T10:23:47.443654+0000","last_became_peered":"2024-05-08T10:23:47.443654+0000","last_unstale":"2024-05-08T10:23:50.072152+0000","last_undegraded":"2024-05-08T10:23:50.072152+0000","last_fullsized":"2024-05-08T10:23:50.072152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:30.687087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439533+0000","last_change":"2024-05-08T10:23:48.444924+0000","last_active":"2024-05-08T10:23:49.439533+0000","last_peered":"2024-05-08T10:23:49.439533+0000","last_clean":"2024-05-08T10:23:49.439533+0000","last_became_active":"2024-05-08T10:23:48.444666+0000","last_became_peered":"2024-05-08T10:23:48.444666+0000","last_unstale":"2024-05-08T10:23:49.439533+0000","last_undegraded":"2024-05-08T10:23:49.439533+0000","last_fullsized":"2024-05-08T10:23:49.439533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439457+0000","last_change":"2024-05-08T10:23:47.440367+0000","last_active":"2024-05-08T10:23:49.439457+0000","last_peered":"2024-05-08T10:23:49.439457+0000","last_clean":"2024-05-08T10:23:49.439457+0000","last_became_active":"2024-05-08T10:23:47.440098+0000","last_became_peered":"2024-05-08T10:23:47.440098+0000","last_unstale":"2024-05-08T10:23:49.439457+0000","last_undegraded":"2024-05-08T10:23:49.439457+0000","last_fullsized":"2024-05-08T10:23:49.439457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071073+0000","last_change":"2024-05-08T10:23:48.451970+0000","last_active":"2024-05-08T10:23:50.071073+0000","last_peered":"2024-05-08T10:23:50.071073+0000","last_clean":"2024-05-08T10:23:50.071073+0000","last_became_active":"2024-05-08T10:23:48.451718+0000","last_became_peered":"2024-05-08T10:23:48.451718+0000","last_unstale":"2024-05-08T10:23:50.071073+0000","last_undegraded":"2024-05-08T10:23:50.071073+0000","last_fullsized":"2024-05-08T10:23:50.071073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070016+0000","last_change":"2024-05-08T10:23:47.441809+0000","last_active":"2024-05-08T10:23:50.070016+0000","last_peered":"2024-05-08T10:23:50.070016+0000","last_clean":"2024-05-08T10:23:50.070016+0000","last_became_active":"2024-05-08T10:23:47.441527+0000","last_became_peered":"2024-05-08T10:23:47.441527+0000","last_unstale":"2024-05-08T10:23:50.070016+0000","last_undegraded":"2024-05-08T10:23:50.070016+0000","last_fullsized":"2024-05-08T10:23:50.070016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071600+0000","last_change":"2024-05-08T10:23:48.449529+0000","last_active":"2024-05-08T10:23:50.071600+0000","last_peered":"2024-05-08T10:23:50.071600+0000","last_clean":"2024-05-08T10:23:50.071600+0000","last_became_active":"2024-05-08T10:23:48.449277+0000","last_became_peered":"2024-05-08T10:23:48.449277+0000","last_unstale":"2024-05-08T10:23:50.071600+0000","last_undegraded":"2024-05-08T10:23:50.071600+0000","last_fullsized":"2024-05-08T10:23:50.071600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071278+0000","last_change":"2024-05-08T10:23:47.443969+0000","last_active":"2024-05-08T10:23:50.071278+0000","last_peered":"2024-05-08T10:23:50.071278+0000","last_clean":"2024-05-08T10:23:50.071278+0000","last_became_active":"2024-05-08T10:23:47.443699+0000","last_became_peered":"2024-05-08T10:23:47.443699+0000","last_unstale":"2024-05-08T10:23:50.071278+0000","last_undegraded":"2024-05-08T10:23:50.071278+0000","last_fullsized":"2024-05-08T10:23:50.071278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440154+0000","last_change":"2024-05-08T10:23:48.434030+0000","last_active":"2024-05-08T10:23:49.440154+0000","last_peered":"2024-05-08T10:23:49.440154+0000","last_clean":"2024-05-08T10:23:49.440154+0000","last_became_active":"2024-05-08T10:23:48.432607+0000","last_became_peered":"2024-05-08T10:23:48.432607+0000","last_unstale":"2024-05-08T10:23:49.440154+0000","last_undegraded":"2024-05-08T10:23:49.440154+0000","last_fullsized":"2024-05-08T10:23:49.440154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:49.151330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439287+0000","last_change":"2024-05-08T10:23:47.441563+0000","last_active":"2024-05-08T10:23:49.439287+0000","last_peered":"2024-05-08T10:23:49.439287+0000","last_clean":"2024-05-08T10:23:49.439287+0000","last_became_active":"2024-05-08T10:23:47.441300+0000","last_became_peered":"2024-05-08T10:23:47.441300+0000","last_unstale":"2024-05-08T10:23:49.439287+0000","last_undegraded":"2024-05-08T10:23:49.439287+0000","last_fullsized":"2024-05-08T10:23:49.439287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070974+0000","last_change":"2024-05-08T10:23:48.447037+0000","last_active":"2024-05-08T10:23:50.070974+0000","last_peered":"2024-05-08T10:23:50.070974+0000","last_clean":"2024-05-08T10:23:50.070974+0000","last_became_active":"2024-05-08T10:23:48.446758+0000","last_became_peered":"2024-05-08T10:23:48.446758+0000","last_unstale":"2024-05-08T10:23:50.070974+0000","last_undegraded":"2024-05-08T10:23:50.070974+0000","last_fullsized":"2024-05-08T10:23:50.070974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439217+0000","last_change":"2024-05-08T10:23:47.438095+0000","last_active":"2024-05-08T10:23:49.439217+0000","last_peered":"2024-05-08T10:23:49.439217+0000","last_clean":"2024-05-08T10:23:49.439217+0000","last_became_active":"2024-05-08T10:23:47.437623+0000","last_became_peered":"2024-05-08T10:23:47.437623+0000","last_unstale":"2024-05-08T10:23:49.439217+0000","last_undegraded":"2024-05-08T10:23:49.439217+0000","last_fullsized":"2024-05-08T10:23:49.439217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071504+0000","last_change":"2024-05-08T10:23:48.440080+0000","last_active":"2024-05-08T10:23:50.071504+0000","last_peered":"2024-05-08T10:23:50.071504+0000","last_clean":"2024-05-08T10:23:50.071504+0000","last_became_active":"2024-05-08T10:23:48.439806+0000","last_became_peered":"2024-05-08T10:23:48.439806+0000","last_unstale":"2024-05-08T10:23:50.071504+0000","last_undegraded":"2024-05-08T10:23:50.071504+0000","last_fullsized":"2024-05-08T10:23:50.071504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:53:25.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071944+0000","last_change":"2024-05-08T10:23:47.441909+0000","last_active":"2024-05-08T10:23:50.071944+0000","last_peered":"2024-05-08T10:23:50.071944+0000","last_clean":"2024-05-08T10:23:50.071944+0000","last_became_active":"2024-05-08T10:23:47.441503+0000","last_became_peered":"2024-05-08T10:23:47.441503+0000","last_unstale":"2024-05-08T10:23:50.071944+0000","last_undegraded":"2024-05-08T10:23:50.071944+0000","last_fullsized":"2024-05-08T10:23:50.071944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:03.877856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069602+0000","last_change":"2024-05-08T10:23:48.442495+0000","last_active":"2024-05-08T10:23:50.069602+0000","last_peered":"2024-05-08T10:23:50.069602+0000","last_clean":"2024-05-08T10:23:50.069602+0000","last_became_active":"2024-05-08T10:23:48.442219+0000","last_became_peered":"2024-05-08T10:23:48.442219+0000","last_unstale":"2024-05-08T10:23:50.069602+0000","last_undegraded":"2024-05-08T10:23:50.069602+0000","last_fullsized":"2024-05-08T10:23:50.069602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071714+0000","last_change":"2024-05-08T10:23:48.450618+0000","last_active":"2024-05-08T10:23:50.071714+0000","last_peered":"2024-05-08T10:23:50.071714+0000","last_clean":"2024-05-08T10:23:50.071714+0000","last_became_active":"2024-05-08T10:23:48.450339+0000","last_became_peered":"2024-05-08T10:23:48.450339+0000","last_unstale":"2024-05-08T10:23:50.071714+0000","last_undegraded":"2024-05-08T10:23:50.071714+0000","last_fullsized":"2024-05-08T10:23:50.071714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:16.618080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072177+0000","last_change":"2024-05-08T10:23:47.439945+0000","last_active":"2024-05-08T10:23:50.072177+0000","last_peered":"2024-05-08T10:23:50.072177+0000","last_clean":"2024-05-08T10:23:50.072177+0000","last_became_active":"2024-05-08T10:23:47.439631+0000","last_became_peered":"2024-05-08T10:23:47.439631+0000","last_unstale":"2024-05-08T10:23:50.072177+0000","last_undegraded":"2024-05-08T10:23:50.072177+0000","last_fullsized":"2024-05-08T10:23:50.072177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071282+0000","last_change":"2024-05-08T10:23:48.449884+0000","last_active":"2024-05-08T10:23:50.071282+0000","last_peered":"2024-05-08T10:23:50.071282+0000","last_clean":"2024-05-08T10:23:50.071282+0000","last_became_active":"2024-05-08T10:23:48.449628+0000","last_became_peered":"2024-05-08T10:23:48.449628+0000","last_unstale":"2024-05-08T10:23:50.071282+0000","last_undegraded":"2024-05-08T10:23:50.071282+0000","last_fullsized":"2024-05-08T10:23:50.071282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.646809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071959+0000","last_change":"2024-05-08T10:23:47.442600+0000","last_active":"2024-05-08T10:23:50.071959+0000","last_peered":"2024-05-08T10:23:50.071959+0000","last_clean":"2024-05-08T10:23:50.071959+0000","last_became_active":"2024-05-08T10:23:47.441385+0000","last_became_peered":"2024-05-08T10:23:47.441385+0000","last_unstale":"2024-05-08T10:23:50.071959+0000","last_undegraded":"2024-05-08T10:23:50.071959+0000","last_fullsized":"2024-05-08T10:23:50.071959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:08.211133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071411+0000","last_change":"2024-05-08T10:23:48.451860+0000","last_active":"2024-05-08T10:23:50.071411+0000","last_peered":"2024-05-08T10:23:50.071411+0000","last_clean":"2024-05-08T10:23:50.071411+0000","last_became_active":"2024-05-08T10:23:48.451546+0000","last_became_peered":"2024-05-08T10:23:48.451546+0000","last_unstale":"2024-05-08T10:23:50.071411+0000","last_undegraded":"2024-05-08T10:23:50.071411+0000","last_fullsized":"2024-05-08T10:23:50.071411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:57.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071239+0000","last_change":"2024-05-08T10:23:47.435845+0000","last_active":"2024-05-08T10:23:50.071239+0000","last_peered":"2024-05-08T10:23:50.071239+0000","last_clean":"2024-05-08T10:23:50.071239+0000","last_became_active":"2024-05-08T10:23:47.435557+0000","last_became_peered":"2024-05-08T10:23:47.435557+0000","last_unstale":"2024-05-08T10:23:50.071239+0000","last_undegraded":"2024-05-08T10:23:50.071239+0000","last_fullsized":"2024-05-08T10:23:50.071239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071173+0000","last_change":"2024-05-08T10:23:48.446164+0000","last_active":"2024-05-08T10:23:50.071173+0000","last_peered":"2024-05-08T10:23:50.071173+0000","last_clean":"2024-05-08T10:23:50.071173+0000","last_became_active":"2024-05-08T10:23:48.445903+0000","last_became_peered":"2024-05-08T10:23:48.445903+0000","last_unstale":"2024-05-08T10:23:50.071173+0000","last_undegraded":"2024-05-08T10:23:50.071173+0000","last_fullsized":"2024-05-08T10:23:50.071173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:17.618922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071638+0000","last_change":"2024-05-08T10:23:47.439956+0000","last_active":"2024-05-08T10:23:50.071638+0000","last_peered":"2024-05-08T10:23:50.071638+0000","last_clean":"2024-05-08T10:23:50.071638+0000","last_became_active":"2024-05-08T10:23:47.439661+0000","last_became_peered":"2024-05-08T10:23:47.439661+0000","last_unstale":"2024-05-08T10:23:50.071638+0000","last_undegraded":"2024-05-08T10:23:50.071638+0000","last_fullsized":"2024-05-08T10:23:50.071638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:00.268 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:00.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.420+0000 7f67d4a2a640 1 Processor -- start 2024-05-08T10:24:00.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.420+0000 7f67d4a2a640 1 -- start start 2024-05-08T10:24:00.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.421+0000 7f67d4a2a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d00d0a00 0x7f67d00b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.421+0000 7f67d4a2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f67d00cfc10 0x7f67d00b8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.408 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.421+0000 7f67d4a2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d00d36f0 con 0x7f67d015f760 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.421+0000 7f67d4a2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f67d015fb40 con 0x7f67d00cfc10 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.421+0000 7f67d4a2a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f67d00d00a0 con 0x7f67d00d0a00 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.421+0000 7f67ced9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f67d00cfc10 0x7f67d00b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.421+0000 7f67ce59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f67d015f760 0x7f67d00d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39110/0 (socket says 172.21.15.143:39110) 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.421+0000 7f67ced9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f67d00cfc10 0x7f67d00b8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36354/0 (socket says 172.21.15.143:36354) 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.421+0000 7f67ce59c640 1 -- 172.21.15.143:0/2523893777 learned_addr learned my addr 172.21.15.143:0/2523893777 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.422+0000 7f67cdd9b640 1 --2- 172.21.15.143:0/2523893777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d00d0a00 0x7f67d00b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.422+0000 7f67ced9d640 1 -- 172.21.15.143:0/2523893777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d00d0a00 msgr2=0x7f67d00b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.422+0000 7f67ced9d640 1 --2- 172.21.15.143:0/2523893777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d00d0a00 0x7f67d00b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.422+0000 7f67ced9d640 1 -- 172.21.15.143:0/2523893777 >> v1:172.21.15.143:6789/0 conn(0x7f67d015f760 legacy=0x7f67d00d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.422+0000 7f67ced9d640 1 -- 172.21.15.143:0/2523893777 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d00d39d0 con 0x7f67d00cfc10 2024-05-08T10:24:00.409 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.422+0000 7f67cd59a640 1 -- 172.21.15.143:0/2523893777 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597645723 0 0) 0x7f67d00d36f0 con 0x7f67d015f760 2024-05-08T10:24:00.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.422+0000 7f67ced9d640 1 --2- 172.21.15.143:0/2523893777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00cfc10 0x7f67d00b8710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f67c80097a0 tx=0x7f67c802a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2006a4f32854ab64 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:00.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67cd59a640 1 -- 172.21.15.143:0/2523893777 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8037070 con 0x7f67d00cfc10 2024-05-08T10:24:00.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67cd59a640 1 -- 172.21.15.143:0/2523893777 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c802ae30 con 0x7f67d00cfc10 2024-05-08T10:24:00.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67cd59a640 1 -- 172.21.15.143:0/2523893777 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8032640 con 0x7f67d00cfc10 2024-05-08T10:24:00.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2523893777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00cfc10 msgr2=0x7f67d00b8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67d4a2a640 1 --2- 172.21.15.143:0/2523893777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00cfc10 0x7f67d00b8710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f67c80097a0 tx=0x7f67c802a0e0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2523893777 shutdown_connections 2024-05-08T10:24:00.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67d4a2a640 1 --2- 172.21.15.143:0/2523893777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00cfc10 0x7f67d00b8710 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67d4a2a640 1 --2- 172.21.15.143:0/2523893777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d00d0a00 0x7f67d00b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2523893777 >> 172.21.15.143:0/2523893777 conn(0x7f67d00740e0 msgr2=0x7f67d006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:00.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2523893777 shutdown_connections 2024-05-08T10:24:00.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.423+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2523893777 wait complete. 2024-05-08T10:24:00.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.424+0000 7f67d4a2a640 1 Processor -- start 2024-05-08T10:24:00.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67d4a2a640 1 -- start start 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67d4a2a640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d00cfc10 0x7f67d0158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67d4a2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00d0a00 0x7f67d0160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67d4a2a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d015f760 0x7f67d01f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67d4a2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f67d00d4270 con 0x7f67d00d0a00 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67d4a2a640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f67d00d3f90 con 0x7f67d00cfc10 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67d4a2a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f67d00d4790 con 0x7f67d015f760 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67cdd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00d0a00 0x7f67d0160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67cdd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00d0a00 0x7f67d0160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36366/0 (socket says 172.21.15.143:36366) 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67cdd9b640 1 -- 172.21.15.143:0/2147636391 learned_addr learned my addr 172.21.15.143:0/2147636391 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.425+0000 7f67ce59c640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d00cfc10 0x7f67d0158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67ced9d640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d015f760 0x7f67d01f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67cdd9b640 1 -- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d015f760 msgr2=0x7f67d01f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67cdd9b640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d015f760 0x7f67d01f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67cdd9b640 1 -- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d00cfc10 msgr2=0x7f67d0158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67cdd9b640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d00cfc10 0x7f67d0158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67cdd9b640 1 -- 172.21.15.143:0/2147636391 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d0158d80 con 0x7f67d00d0a00 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67ce59c640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d00cfc10 0x7f67d0158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67ced9d640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d015f760 0x7f67d01f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67cdd9b640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00d0a00 0x7f67d0160560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c7f0 tx=0x7f67c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67beffd640 1 -- 172.21.15.143:0/2147636391 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4015070 con 0x7f67d00d0a00 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67beffd640 1 -- 172.21.15.143:0/2147636391 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c4004240 con 0x7f67d00d0a00 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d01f62c0 con 0x7f67d00d0a00 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67beffd640 1 -- 172.21.15.143:0/2147636391 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4003610 con 0x7f67d00d0a00 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.426+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d015fd60 con 0x7f67d00d0a00 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.427+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d006a550 con 0x7f67d00d0a00 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.427+0000 7f67beffd640 1 -- 172.21.15.143:0/2147636391 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f67c40039c0 con 0x7f67d00d0a00 2024-05-08T10:24:00.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.428+0000 7f67beffd640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67b00762d0 0x7f67b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.428+0000 7f67ce59c640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67b00762d0 0x7f67b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.428+0000 7f67beffd640 1 -- 172.21.15.143:0/2147636391 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f67c4097a00 con 0x7f67d00d0a00 2024-05-08T10:24:00.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.428+0000 7f67ce59c640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67b00762d0 0x7f67b0078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67c00015a0 tx=0x7f67c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:00.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.432+0000 7f67beffd640 1 -- 172.21.15.143:0/2147636391 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f67c4061360 con 0x7f67d00d0a00 2024-05-08T10:24:00.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.613+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67d0069660 con 0x7f67b00762d0 2024-05-08T10:24:00.605 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.619+0000 7f67beffd640 1 -- 172.21.15.143:0/2147636391 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f67d0069660 con 0x7f67b00762d0 2024-05-08T10:24:00.607 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:00.608 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:00.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67b00762d0 msgr2=0x7f67b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67b00762d0 0x7f67b0078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67c00015a0 tx=0x7f67c0009040 comp rx=0 tx=0).stop 2024-05-08T10:24:00.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00d0a00 msgr2=0x7f67d0160560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00d0a00 0x7f67d0160560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c7f0 tx=0x7f67c400ccb0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 shutdown_connections 2024-05-08T10:24:00.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d015f760 0x7f67d01f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67b00762d0 0x7f67b0078790 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d00d0a00 0x7f67d0160560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 --2- 172.21.15.143:0/2147636391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d00cfc10 0x7f67d0158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.622+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 >> 172.21.15.143:0/2147636391 conn(0x7f67d00740e0 msgr2=0x7f67d00cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:00.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.623+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 shutdown_connections 2024-05-08T10:24:00.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.623+0000 7f67d4a2a640 1 -- 172.21.15.143:0/2147636391 wait complete. 2024-05-08T10:24:00.619 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-08T10:24:00.527026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.089375"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071730+0000","last_change":"2024-05-08T10:23:48.455169+0000","last_active":"2024-05-08T10:23:50.071730+0000","last_peered":"2024-05-08T10:23:50.071730+0000","last_clean":"2024-05-08T10:23:50.071730+0000","last_became_active":"2024-05-08T10:23:48.454403+0000","last_became_peered":"2024-05-08T10:23:48.454403+0000","last_unstale":"2024-05-08T10:23:50.071730+0000","last_undegraded":"2024-05-08T10:23:50.071730+0000","last_fullsized":"2024-05-08T10:23:50.071730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:56.686042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439355+0000","last_change":"2024-05-08T10:23:48.442523+0000","last_active":"2024-05-08T10:23:49.439355+0000","last_peered":"2024-05-08T10:23:49.439355+0000","last_clean":"2024-05-08T10:23:49.439355+0000","last_became_active":"2024-05-08T10:23:48.442211+0000","last_became_peered":"2024-05-08T10:23:48.442211+0000","last_unstale":"2024-05-08T10:23:49.439355+0000","last_undegraded":"2024-05-08T10:23:49.439355+0000","last_fullsized":"2024-05-08T10:23:49.439355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071683+0000","last_change":"2024-05-08T10:23:48.438711+0000","last_active":"2024-05-08T10:23:50.071683+0000","last_peered":"2024-05-08T10:23:50.071683+0000","last_clean":"2024-05-08T10:23:50.071683+0000","last_became_active":"2024-05-08T10:23:48.438466+0000","last_became_peered":"2024-05-08T10:23:48.438466+0000","last_unstale":"2024-05-08T10:23:50.071683+0000","last_undegraded":"2024-05-08T10:23:50.071683+0000","last_fullsized":"2024-05-08T10:23:50.071683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071038+0000","last_change":"2024-05-08T10:23:48.452779+0000","last_active":"2024-05-08T10:23:50.071038+0000","last_peered":"2024-05-08T10:23:50.071038+0000","last_clean":"2024-05-08T10:23:50.071038+0000","last_became_active":"2024-05-08T10:23:48.452512+0000","last_became_peered":"2024-05-08T10:23:48.452512+0000","last_unstale":"2024-05-08T10:23:50.071038+0000","last_undegraded":"2024-05-08T10:23:50.071038+0000","last_fullsized":"2024-05-08T10:23:50.071038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:53:25.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071595+0000","last_change":"2024-05-08T10:23:48.444482+0000","last_active":"2024-05-08T10:23:50.071595+0000","last_peered":"2024-05-08T10:23:50.071595+0000","last_clean":"2024-05-08T10:23:50.071595+0000","last_became_active":"2024-05-08T10:23:48.444220+0000","last_became_peered":"2024-05-08T10:23:48.444220+0000","last_unstale":"2024-05-08T10:23:50.071595+0000","last_undegraded":"2024-05-08T10:23:50.071595+0000","last_fullsized":"2024-05-08T10:23:50.071595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:16.618080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070751+0000","last_change":"2024-05-08T10:23:48.452552+0000","last_active":"2024-05-08T10:23:50.070751+0000","last_peered":"2024-05-08T10:23:50.070751+0000","last_clean":"2024-05-08T10:23:50.070751+0000","last_became_active":"2024-05-08T10:23:48.452278+0000","last_became_peered":"2024-05-08T10:23:48.452278+0000","last_unstale":"2024-05-08T10:23:50.070751+0000","last_undegraded":"2024-05-08T10:23:50.070751+0000","last_fullsized":"2024-05-08T10:23:50.070751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:19.879536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071656+0000","last_change":"2024-05-08T10:23:48.449071+0000","last_active":"2024-05-08T10:23:50.071656+0000","last_peered":"2024-05-08T10:23:50.071656+0000","last_clean":"2024-05-08T10:23:50.071656+0000","last_became_active":"2024-05-08T10:23:48.448781+0000","last_became_peered":"2024-05-08T10:23:48.448781+0000","last_unstale":"2024-05-08T10:23:50.071656+0000","last_undegraded":"2024-05-08T10:23:50.071656+0000","last_fullsized":"2024-05-08T10:23:50.071656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:03.419955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070796+0000","last_change":"2024-05-08T10:23:48.450877+0000","last_active":"2024-05-08T10:23:50.070796+0000","last_peered":"2024-05-08T10:23:50.070796+0000","last_clean":"2024-05-08T10:23:50.070796+0000","last_became_active":"2024-05-08T10:23:48.450628+0000","last_became_peered":"2024-05-08T10:23:48.450628+0000","last_unstale":"2024-05-08T10:23:50.070796+0000","last_undegraded":"2024-05-08T10:23:50.070796+0000","last_fullsized":"2024-05-08T10:23:50.070796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071902+0000","last_change":"2024-05-08T10:23:48.455413+0000","last_active":"2024-05-08T10:23:50.071902+0000","last_peered":"2024-05-08T10:23:50.071902+0000","last_clean":"2024-05-08T10:23:50.071902+0000","last_became_active":"2024-05-08T10:23:48.454809+0000","last_became_peered":"2024-05-08T10:23:48.454809+0000","last_unstale":"2024-05-08T10:23:50.071902+0000","last_undegraded":"2024-05-08T10:23:50.071902+0000","last_fullsized":"2024-05-08T10:23:50.071902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:52.424060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070075+0000","last_change":"2024-05-08T10:23:48.452786+0000","last_active":"2024-05-08T10:23:50.070075+0000","last_peered":"2024-05-08T10:23:50.070075+0000","last_clean":"2024-05-08T10:23:50.070075+0000","last_became_active":"2024-05-08T10:23:48.452530+0000","last_became_peered":"2024-05-08T10:23:48.452530+0000","last_unstale":"2024-05-08T10:23:50.070075+0000","last_undegraded":"2024-05-08T10:23:50.070075+0000","last_fullsized":"2024-05-08T10:23:50.070075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069864+0000","last_change":"2024-05-08T10:23:48.452235+0000","last_active":"2024-05-08T10:23:50.069864+0000","last_peered":"2024-05-08T10:23:50.069864+0000","last_clean":"2024-05-08T10:23:50.069864+0000","last_became_active":"2024-05-08T10:23:48.451251+0000","last_became_peered":"2024-05-08T10:23:48.451251+0000","last_unstale":"2024-05-08T10:23:50.069864+0000","last_undegraded":"2024-05-08T10:23:50.069864+0000","last_fullsized":"2024-05-08T10:23:50.069864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440335+0000","last_change":"2024-05-08T10:23:48.445982+0000","last_active":"2024-05-08T10:23:49.440335+0000","last_peered":"2024-05-08T10:23:49.440335+0000","last_clean":"2024-05-08T10:23:49.440335+0000","last_became_active":"2024-05-08T10:23:48.445309+0000","last_became_peered":"2024-05-08T10:23:48.445309+0000","last_unstale":"2024-05-08T10:23:49.440335+0000","last_undegraded":"2024-05-08T10:23:49.440335+0000","last_fullsized":"2024-05-08T10:23:49.440335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:35.017589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071368+0000","last_change":"2024-05-08T10:23:48.446813+0000","last_active":"2024-05-08T10:23:50.071368+0000","last_peered":"2024-05-08T10:23:50.071368+0000","last_clean":"2024-05-08T10:23:50.071368+0000","last_became_active":"2024-05-08T10:23:48.446447+0000","last_became_peered":"2024-05-08T10:23:48.446447+0000","last_unstale":"2024-05-08T10:23:50.071368+0000","last_undegraded":"2024-05-08T10:23:50.071368+0000","last_fullsized":"2024-05-08T10:23:50.071368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:56.686042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071183+0000","last_change":"2024-05-08T10:23:48.449737+0000","last_active":"2024-05-08T10:23:50.071183+0000","last_peered":"2024-05-08T10:23:50.071183+0000","last_clean":"2024-05-08T10:23:50.071183+0000","last_became_active":"2024-05-08T10:23:48.449477+0000","last_became_peered":"2024-05-08T10:23:48.449477+0000","last_unstale":"2024-05-08T10:23:50.071183+0000","last_undegraded":"2024-05-08T10:23:50.071183+0000","last_fullsized":"2024-05-08T10:23:50.071183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:00.805521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439204+0000","last_change":"2024-05-08T10:23:48.441880+0000","last_active":"2024-05-08T10:23:49.439204+0000","last_peered":"2024-05-08T10:23:49.439204+0000","last_clean":"2024-05-08T10:23:49.439204+0000","last_became_active":"2024-05-08T10:23:48.441190+0000","last_became_peered":"2024-05-08T10:23:48.441190+0000","last_unstale":"2024-05-08T10:23:49.439204+0000","last_undegraded":"2024-05-08T10:23:49.439204+0000","last_fullsized":"2024-05-08T10:23:49.439204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070683+0000","last_change":"2024-05-08T10:23:48.451077+0000","last_active":"2024-05-08T10:23:50.070683+0000","last_peered":"2024-05-08T10:23:50.070683+0000","last_clean":"2024-05-08T10:23:50.070683+0000","last_became_active":"2024-05-08T10:23:48.450806+0000","last_became_peered":"2024-05-08T10:23:48.450806+0000","last_unstale":"2024-05-08T10:23:50.070683+0000","last_undegraded":"2024-05-08T10:23:50.070683+0000","last_fullsized":"2024-05-08T10:23:50.070683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071684+0000","last_change":"2024-05-08T10:23:48.456531+0000","last_active":"2024-05-08T10:23:50.071684+0000","last_peered":"2024-05-08T10:23:50.071684+0000","last_clean":"2024-05-08T10:23:50.071684+0000","last_became_active":"2024-05-08T10:23:48.456284+0000","last_became_peered":"2024-05-08T10:23:48.456284+0000","last_unstale":"2024-05-08T10:23:50.071684+0000","last_undegraded":"2024-05-08T10:23:50.071684+0000","last_fullsized":"2024-05-08T10:23:50.071684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:03.419955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439889+0000","last_change":"2024-05-08T10:23:48.442085+0000","last_active":"2024-05-08T10:23:49.439889+0000","last_peered":"2024-05-08T10:23:49.439889+0000","last_clean":"2024-05-08T10:23:49.439889+0000","last_became_active":"2024-05-08T10:23:48.441801+0000","last_became_peered":"2024-05-08T10:23:48.441801+0000","last_unstale":"2024-05-08T10:23:49.439889+0000","last_undegraded":"2024-05-08T10:23:49.439889+0000","last_fullsized":"2024-05-08T10:23:49.439889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:31.689147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072156+0000","last_change":"2024-05-08T10:23:48.446130+0000","last_active":"2024-05-08T10:23:50.072156+0000","last_peered":"2024-05-08T10:23:50.072156+0000","last_clean":"2024-05-08T10:23:50.072156+0000","last_became_active":"2024-05-08T10:23:48.445847+0000","last_became_peered":"2024-05-08T10:23:48.445847+0000","last_unstale":"2024-05-08T10:23:50.072156+0000","last_undegraded":"2024-05-08T10:23:50.072156+0000","last_fullsized":"2024-05-08T10:23:50.072156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:21.241922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069885+0000","last_change":"2024-05-08T10:23:48.444206+0000","last_active":"2024-05-08T10:23:50.069885+0000","last_peered":"2024-05-08T10:23:50.069885+0000","last_clean":"2024-05-08T10:23:50.069885+0000","last_became_active":"2024-05-08T10:23:48.443938+0000","last_became_peered":"2024-05-08T10:23:48.443938+0000","last_unstale":"2024-05-08T10:23:50.069885+0000","last_undegraded":"2024-05-08T10:23:50.069885+0000","last_fullsized":"2024-05-08T10:23:50.069885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071229+0000","last_change":"2024-05-08T10:23:48.455150+0000","last_active":"2024-05-08T10:23:50.071229+0000","last_peered":"2024-05-08T10:23:50.071229+0000","last_clean":"2024-05-08T10:23:50.071229+0000","last_became_active":"2024-05-08T10:23:48.454911+0000","last_became_peered":"2024-05-08T10:23:48.454911+0000","last_unstale":"2024-05-08T10:23:50.071229+0000","last_undegraded":"2024-05-08T10:23:50.071229+0000","last_fullsized":"2024-05-08T10:23:50.071229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:50:17.413158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070974+0000","last_change":"2024-05-08T10:23:48.455822+0000","last_active":"2024-05-08T10:23:50.070974+0000","last_peered":"2024-05-08T10:23:50.070974+0000","last_clean":"2024-05-08T10:23:50.070974+0000","last_became_active":"2024-05-08T10:23:48.455339+0000","last_became_peered":"2024-05-08T10:23:48.455339+0000","last_unstale":"2024-05-08T10:23:50.070974+0000","last_undegraded":"2024-05-08T10:23:50.070974+0000","last_fullsized":"2024-05-08T10:23:50.070974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:17.618922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070826+0000","last_change":"2024-05-08T10:23:48.436289+0000","last_active":"2024-05-08T10:23:50.070826+0000","last_peered":"2024-05-08T10:23:50.070826+0000","last_clean":"2024-05-08T10:23:50.070826+0000","last_became_active":"2024-05-08T10:23:48.436039+0000","last_became_peered":"2024-05-08T10:23:48.436039+0000","last_unstale":"2024-05-08T10:23:50.070826+0000","last_undegraded":"2024-05-08T10:23:50.070826+0000","last_fullsized":"2024-05-08T10:23:50.070826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071248+0000","last_change":"2024-05-08T10:23:48.450416+0000","last_active":"2024-05-08T10:23:50.071248+0000","last_peered":"2024-05-08T10:23:50.071248+0000","last_clean":"2024-05-08T10:23:50.071248+0000","last_became_active":"2024-05-08T10:23:48.450131+0000","last_became_peered":"2024-05-08T10:23:48.450131+0000","last_unstale":"2024-05-08T10:23:50.071248+0000","last_undegraded":"2024-05-08T10:23:50.071248+0000","last_fullsized":"2024-05-08T10:23:50.071248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:44:13.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071001+0000","last_change":"2024-05-08T10:23:48.437015+0000","last_active":"2024-05-08T10:23:50.071001+0000","last_peered":"2024-05-08T10:23:50.071001+0000","last_clean":"2024-05-08T10:23:50.071001+0000","last_became_active":"2024-05-08T10:23:48.436779+0000","last_became_peered":"2024-05-08T10:23:48.436779+0000","last_unstale":"2024-05-08T10:23:50.071001+0000","last_undegraded":"2024-05-08T10:23:50.071001+0000","last_fullsized":"2024-05-08T10:23:50.071001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070202+0000","last_change":"2024-05-08T10:23:48.443798+0000","last_active":"2024-05-08T10:23:50.070202+0000","last_peered":"2024-05-08T10:23:50.070202+0000","last_clean":"2024-05-08T10:23:50.070202+0000","last_became_active":"2024-05-08T10:23:48.442703+0000","last_became_peered":"2024-05-08T10:23:48.442703+0000","last_unstale":"2024-05-08T10:23:50.070202+0000","last_undegraded":"2024-05-08T10:23:50.070202+0000","last_fullsized":"2024-05-08T10:23:50.070202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:19.879536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439323+0000","last_change":"2024-05-08T10:23:48.448757+0000","last_active":"2024-05-08T10:23:49.439323+0000","last_peered":"2024-05-08T10:23:49.439323+0000","last_clean":"2024-05-08T10:23:49.439323+0000","last_became_active":"2024-05-08T10:23:48.445205+0000","last_became_peered":"2024-05-08T10:23:48.445205+0000","last_unstale":"2024-05-08T10:23:49.439323+0000","last_undegraded":"2024-05-08T10:23:49.439323+0000","last_fullsized":"2024-05-08T10:23:49.439323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071548+0000","last_change":"2024-05-08T10:23:48.436978+0000","last_active":"2024-05-08T10:23:50.071548+0000","last_peered":"2024-05-08T10:23:50.071548+0000","last_clean":"2024-05-08T10:23:50.071548+0000","last_became_active":"2024-05-08T10:23:48.436738+0000","last_became_peered":"2024-05-08T10:23:48.436738+0000","last_unstale":"2024-05-08T10:23:50.071548+0000","last_undegraded":"2024-05-08T10:23:50.071548+0000","last_fullsized":"2024-05-08T10:23:50.071548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:44:13.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071465+0000","last_change":"2024-05-08T10:23:48.443335+0000","last_active":"2024-05-08T10:23:50.071465+0000","last_peered":"2024-05-08T10:23:50.071465+0000","last_clean":"2024-05-08T10:23:50.071465+0000","last_became_active":"2024-05-08T10:23:48.443060+0000","last_became_peered":"2024-05-08T10:23:48.443060+0000","last_unstale":"2024-05-08T10:23:50.071465+0000","last_undegraded":"2024-05-08T10:23:50.071465+0000","last_fullsized":"2024-05-08T10:23:50.071465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071030+0000","last_change":"2024-05-08T10:23:48.450521+0000","last_active":"2024-05-08T10:23:50.071030+0000","last_peered":"2024-05-08T10:23:50.071030+0000","last_clean":"2024-05-08T10:23:50.071030+0000","last_became_active":"2024-05-08T10:23:48.450218+0000","last_became_peered":"2024-05-08T10:23:48.450218+0000","last_unstale":"2024-05-08T10:23:50.071030+0000","last_undegraded":"2024-05-08T10:23:50.071030+0000","last_fullsized":"2024-05-08T10:23:50.071030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:56.686042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439839+0000","last_change":"2024-05-08T10:23:48.451961+0000","last_active":"2024-05-08T10:23:49.439839+0000","last_peered":"2024-05-08T10:23:49.439839+0000","last_clean":"2024-05-08T10:23:49.439839+0000","last_became_active":"2024-05-08T10:23:48.451678+0000","last_became_peered":"2024-05-08T10:23:48.451678+0000","last_unstale":"2024-05-08T10:23:49.439839+0000","last_undegraded":"2024-05-08T10:23:49.439839+0000","last_fullsized":"2024-05-08T10:23:49.439839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:09.213193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069663+0000","last_change":"2024-05-08T10:23:48.443980+0000","last_active":"2024-05-08T10:23:50.069663+0000","last_peered":"2024-05-08T10:23:50.069663+0000","last_clean":"2024-05-08T10:23:50.069663+0000","last_became_active":"2024-05-08T10:23:48.443469+0000","last_became_peered":"2024-05-08T10:23:48.443469+0000","last_unstale":"2024-05-08T10:23:50.069663+0000","last_undegraded":"2024-05-08T10:23:50.069663+0000","last_fullsized":"2024-05-08T10:23:50.069663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440644+0000","last_change":"2024-05-08T10:23:48.442083+0000","last_active":"2024-05-08T10:23:49.440644+0000","last_peered":"2024-05-08T10:23:49.440644+0000","last_clean":"2024-05-08T10:23:49.440644+0000","last_became_active":"2024-05-08T10:23:48.441800+0000","last_became_peered":"2024-05-08T10:23:48.441800+0000","last_unstale":"2024-05-08T10:23:49.440644+0000","last_undegraded":"2024-05-08T10:23:49.440644+0000","last_fullsized":"2024-05-08T10:23:49.440644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:09.213193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071590+0000","last_change":"2024-05-08T10:23:47.440565+0000","last_active":"2024-05-08T10:23:50.071590+0000","last_peered":"2024-05-08T10:23:50.071590+0000","last_clean":"2024-05-08T10:23:50.071590+0000","last_became_active":"2024-05-08T10:23:47.440296+0000","last_became_peered":"2024-05-08T10:23:47.440296+0000","last_unstale":"2024-05-08T10:23:50.071590+0000","last_undegraded":"2024-05-08T10:23:50.071590+0000","last_fullsized":"2024-05-08T10:23:50.071590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071386+0000","last_change":"2024-05-08T10:23:48.448280+0000","last_active":"2024-05-08T10:23:50.071386+0000","last_peered":"2024-05-08T10:23:50.071386+0000","last_clean":"2024-05-08T10:23:50.071386+0000","last_became_active":"2024-05-08T10:23:48.446906+0000","last_became_peered":"2024-05-08T10:23:48.446906+0000","last_unstale":"2024-05-08T10:23:50.071386+0000","last_undegraded":"2024-05-08T10:23:50.071386+0000","last_fullsized":"2024-05-08T10:23:50.071386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:45.698206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069700+0000","last_change":"2024-05-08T10:23:47.432111+0000","last_active":"2024-05-08T10:23:50.069700+0000","last_peered":"2024-05-08T10:23:50.069700+0000","last_clean":"2024-05-08T10:23:50.069700+0000","last_became_active":"2024-05-08T10:23:47.430756+0000","last_became_peered":"2024-05-08T10:23:47.430756+0000","last_unstale":"2024-05-08T10:23:50.069700+0000","last_undegraded":"2024-05-08T10:23:50.069700+0000","last_fullsized":"2024-05-08T10:23:50.069700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070922+0000","last_change":"2024-05-08T10:23:47.431893+0000","last_active":"2024-05-08T10:23:50.070922+0000","last_peered":"2024-05-08T10:23:50.070922+0000","last_clean":"2024-05-08T10:23:50.070922+0000","last_became_active":"2024-05-08T10:23:47.431613+0000","last_became_peered":"2024-05-08T10:23:47.431613+0000","last_unstale":"2024-05-08T10:23:50.070922+0000","last_undegraded":"2024-05-08T10:23:50.070922+0000","last_fullsized":"2024-05-08T10:23:50.070922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:04.235031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070872+0000","last_change":"2024-05-08T10:23:48.440041+0000","last_active":"2024-05-08T10:23:50.070872+0000","last_peered":"2024-05-08T10:23:50.070872+0000","last_clean":"2024-05-08T10:23:50.070872+0000","last_became_active":"2024-05-08T10:23:48.439778+0000","last_became_peered":"2024-05-08T10:23:48.439778+0000","last_unstale":"2024-05-08T10:23:50.070872+0000","last_undegraded":"2024-05-08T10:23:50.070872+0000","last_fullsized":"2024-05-08T10:23:50.070872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070865+0000","last_change":"2024-05-08T10:23:47.436762+0000","last_active":"2024-05-08T10:23:50.070865+0000","last_peered":"2024-05-08T10:23:50.070865+0000","last_clean":"2024-05-08T10:23:50.070865+0000","last_became_active":"2024-05-08T10:23:47.436442+0000","last_became_peered":"2024-05-08T10:23:47.436442+0000","last_unstale":"2024-05-08T10:23:50.070865+0000","last_undegraded":"2024-05-08T10:23:50.070865+0000","last_fullsized":"2024-05-08T10:23:50.070865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439049+0000","last_change":"2024-05-08T10:23:48.442152+0000","last_active":"2024-05-08T10:23:49.439049+0000","last_peered":"2024-05-08T10:23:49.439049+0000","last_clean":"2024-05-08T10:23:49.439049+0000","last_became_active":"2024-05-08T10:23:48.441502+0000","last_became_peered":"2024-05-08T10:23:48.441502+0000","last_unstale":"2024-05-08T10:23:49.439049+0000","last_undegraded":"2024-05-08T10:23:49.439049+0000","last_fullsized":"2024-05-08T10:23:49.439049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069890+0000","last_change":"2024-05-08T10:23:47.439183+0000","last_active":"2024-05-08T10:23:50.069890+0000","last_peered":"2024-05-08T10:23:50.069890+0000","last_clean":"2024-05-08T10:23:50.069890+0000","last_became_active":"2024-05-08T10:23:47.438842+0000","last_became_peered":"2024-05-08T10:23:47.438842+0000","last_unstale":"2024-05-08T10:23:50.069890+0000","last_undegraded":"2024-05-08T10:23:50.069890+0000","last_fullsized":"2024-05-08T10:23:50.069890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071287+0000","last_change":"2024-05-08T10:23:48.455537+0000","last_active":"2024-05-08T10:23:50.071287+0000","last_peered":"2024-05-08T10:23:50.071287+0000","last_clean":"2024-05-08T10:23:50.071287+0000","last_became_active":"2024-05-08T10:23:48.455276+0000","last_became_peered":"2024-05-08T10:23:48.455276+0000","last_unstale":"2024-05-08T10:23:50.071287+0000","last_undegraded":"2024-05-08T10:23:50.071287+0000","last_fullsized":"2024-05-08T10:23:50.071287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:31.821509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071153+0000","last_change":"2024-05-08T10:23:47.442360+0000","last_active":"2024-05-08T10:23:50.071153+0000","last_peered":"2024-05-08T10:23:50.071153+0000","last_clean":"2024-05-08T10:23:50.071153+0000","last_became_active":"2024-05-08T10:23:47.442107+0000","last_became_peered":"2024-05-08T10:23:47.442107+0000","last_unstale":"2024-05-08T10:23:50.071153+0000","last_undegraded":"2024-05-08T10:23:50.071153+0000","last_fullsized":"2024-05-08T10:23:50.071153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071781+0000","last_change":"2024-05-08T10:23:48.451904+0000","last_active":"2024-05-08T10:23:50.071781+0000","last_peered":"2024-05-08T10:23:50.071781+0000","last_clean":"2024-05-08T10:23:50.071781+0000","last_became_active":"2024-05-08T10:23:48.451622+0000","last_became_peered":"2024-05-08T10:23:48.451622+0000","last_unstale":"2024-05-08T10:23:50.071781+0000","last_undegraded":"2024-05-08T10:23:50.071781+0000","last_fullsized":"2024-05-08T10:23:50.071781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439437+0000","last_change":"2024-05-08T10:23:47.438561+0000","last_active":"2024-05-08T10:23:49.439437+0000","last_peered":"2024-05-08T10:23:49.439437+0000","last_clean":"2024-05-08T10:23:49.439437+0000","last_became_active":"2024-05-08T10:23:47.437710+0000","last_became_peered":"2024-05-08T10:23:47.437710+0000","last_unstale":"2024-05-08T10:23:49.439437+0000","last_undegraded":"2024-05-08T10:23:49.439437+0000","last_fullsized":"2024-05-08T10:23:49.439437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440449+0000","last_change":"2024-05-08T10:23:48.442317+0000","last_active":"2024-05-08T10:23:49.440449+0000","last_peered":"2024-05-08T10:23:49.440449+0000","last_clean":"2024-05-08T10:23:49.440449+0000","last_became_active":"2024-05-08T10:23:48.440195+0000","last_became_peered":"2024-05-08T10:23:48.440195+0000","last_unstale":"2024-05-08T10:23:49.440449+0000","last_undegraded":"2024-05-08T10:23:49.440449+0000","last_fullsized":"2024-05-08T10:23:49.440449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:04.879915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069882+0000","last_change":"2024-05-08T10:23:47.436584+0000","last_active":"2024-05-08T10:23:50.069882+0000","last_peered":"2024-05-08T10:23:50.069882+0000","last_clean":"2024-05-08T10:23:50.069882+0000","last_became_active":"2024-05-08T10:23:47.436126+0000","last_became_peered":"2024-05-08T10:23:47.436126+0000","last_unstale":"2024-05-08T10:23:50.069882+0000","last_undegraded":"2024-05-08T10:23:50.069882+0000","last_fullsized":"2024-05-08T10:23:50.069882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071655+0000","last_change":"2024-05-08T10:23:48.448534+0000","last_active":"2024-05-08T10:23:50.071655+0000","last_peered":"2024-05-08T10:23:50.071655+0000","last_clean":"2024-05-08T10:23:50.071655+0000","last_became_active":"2024-05-08T10:23:48.448301+0000","last_became_peered":"2024-05-08T10:23:48.448301+0000","last_unstale":"2024-05-08T10:23:50.071655+0000","last_undegraded":"2024-05-08T10:23:50.071655+0000","last_fullsized":"2024-05-08T10:23:50.071655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:17.618922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071724+0000","last_change":"2024-05-08T10:23:47.435055+0000","last_active":"2024-05-08T10:23:50.071724+0000","last_peered":"2024-05-08T10:23:50.071724+0000","last_clean":"2024-05-08T10:23:50.071724+0000","last_became_active":"2024-05-08T10:23:47.434642+0000","last_became_peered":"2024-05-08T10:23:47.434642+0000","last_unstale":"2024-05-08T10:23:50.071724+0000","last_undegraded":"2024-05-08T10:23:50.071724+0000","last_fullsized":"2024-05-08T10:23:50.071724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:52.270768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071520+0000","last_change":"2024-05-08T10:23:48.443473+0000","last_active":"2024-05-08T10:23:50.071520+0000","last_peered":"2024-05-08T10:23:50.071520+0000","last_clean":"2024-05-08T10:23:50.071520+0000","last_became_active":"2024-05-08T10:23:48.443180+0000","last_became_peered":"2024-05-08T10:23:48.443180+0000","last_unstale":"2024-05-08T10:23:50.071520+0000","last_undegraded":"2024-05-08T10:23:50.071520+0000","last_fullsized":"2024-05-08T10:23:50.071520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071108+0000","last_change":"2024-05-08T10:23:47.437417+0000","last_active":"2024-05-08T10:23:50.071108+0000","last_peered":"2024-05-08T10:23:50.071108+0000","last_clean":"2024-05-08T10:23:50.071108+0000","last_became_active":"2024-05-08T10:23:47.437129+0000","last_became_peered":"2024-05-08T10:23:47.437129+0000","last_unstale":"2024-05-08T10:23:50.071108+0000","last_undegraded":"2024-05-08T10:23:50.071108+0000","last_fullsized":"2024-05-08T10:23:50.071108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071661+0000","last_change":"2024-05-08T10:23:48.441913+0000","last_active":"2024-05-08T10:23:50.071661+0000","last_peered":"2024-05-08T10:23:50.071661+0000","last_clean":"2024-05-08T10:23:50.071661+0000","last_became_active":"2024-05-08T10:23:48.439621+0000","last_became_peered":"2024-05-08T10:23:48.439621+0000","last_unstale":"2024-05-08T10:23:50.071661+0000","last_undegraded":"2024-05-08T10:23:50.071661+0000","last_fullsized":"2024-05-08T10:23:50.071661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:44:13.562900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069650+0000","last_change":"2024-05-08T10:23:47.432460+0000","last_active":"2024-05-08T10:23:50.069650+0000","last_peered":"2024-05-08T10:23:50.069650+0000","last_clean":"2024-05-08T10:23:50.069650+0000","last_became_active":"2024-05-08T10:23:47.432156+0000","last_became_peered":"2024-05-08T10:23:47.432156+0000","last_unstale":"2024-05-08T10:23:50.069650+0000","last_undegraded":"2024-05-08T10:23:50.069650+0000","last_fullsized":"2024-05-08T10:23:50.069650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069545+0000","last_change":"2024-05-08T10:23:48.443752+0000","last_active":"2024-05-08T10:23:50.069545+0000","last_peered":"2024-05-08T10:23:50.069545+0000","last_clean":"2024-05-08T10:23:50.069545+0000","last_became_active":"2024-05-08T10:23:48.443133+0000","last_became_peered":"2024-05-08T10:23:48.443133+0000","last_unstale":"2024-05-08T10:23:50.069545+0000","last_undegraded":"2024-05-08T10:23:50.069545+0000","last_fullsized":"2024-05-08T10:23:50.069545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439625+0000","last_change":"2024-05-08T10:23:47.439271+0000","last_active":"2024-05-08T10:23:49.439625+0000","last_peered":"2024-05-08T10:23:49.439625+0000","last_clean":"2024-05-08T10:23:49.439625+0000","last_became_active":"2024-05-08T10:23:47.438952+0000","last_became_peered":"2024-05-08T10:23:47.438952+0000","last_unstale":"2024-05-08T10:23:49.439625+0000","last_undegraded":"2024-05-08T10:23:49.439625+0000","last_fullsized":"2024-05-08T10:23:49.439625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071730+0000","last_change":"2024-05-08T10:23:48.450406+0000","last_active":"2024-05-08T10:23:50.071730+0000","last_peered":"2024-05-08T10:23:50.071730+0000","last_clean":"2024-05-08T10:23:50.071730+0000","last_became_active":"2024-05-08T10:23:48.450137+0000","last_became_peered":"2024-05-08T10:23:48.450137+0000","last_unstale":"2024-05-08T10:23:50.071730+0000","last_undegraded":"2024-05-08T10:23:50.071730+0000","last_fullsized":"2024-05-08T10:23:50.071730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:53:25.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440561+0000","last_change":"2024-05-08T10:23:47.436054+0000","last_active":"2024-05-08T10:23:49.440561+0000","last_peered":"2024-05-08T10:23:49.440561+0000","last_clean":"2024-05-08T10:23:49.440561+0000","last_became_active":"2024-05-08T10:23:47.435777+0000","last_became_peered":"2024-05-08T10:23:47.435777+0000","last_unstale":"2024-05-08T10:23:49.440561+0000","last_undegraded":"2024-05-08T10:23:49.440561+0000","last_fullsized":"2024-05-08T10:23:49.440561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:36.186211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071790+0000","last_change":"2024-05-08T10:23:48.439230+0000","last_active":"2024-05-08T10:23:50.071790+0000","last_peered":"2024-05-08T10:23:50.071790+0000","last_clean":"2024-05-08T10:23:50.071790+0000","last_became_active":"2024-05-08T10:23:48.438944+0000","last_became_peered":"2024-05-08T10:23:48.438944+0000","last_unstale":"2024-05-08T10:23:50.071790+0000","last_undegraded":"2024-05-08T10:23:50.071790+0000","last_fullsized":"2024-05-08T10:23:50.071790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.646809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439834+0000","last_change":"2024-05-08T10:23:47.428146+0000","last_active":"2024-05-08T10:23:49.439834+0000","last_peered":"2024-05-08T10:23:49.439834+0000","last_clean":"2024-05-08T10:23:49.439834+0000","last_became_active":"2024-05-08T10:23:47.427826+0000","last_became_peered":"2024-05-08T10:23:47.427826+0000","last_unstale":"2024-05-08T10:23:49.439834+0000","last_undegraded":"2024-05-08T10:23:49.439834+0000","last_fullsized":"2024-05-08T10:23:49.439834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072114+0000","last_change":"2024-05-08T10:23:48.456216+0000","last_active":"2024-05-08T10:23:50.072114+0000","last_peered":"2024-05-08T10:23:50.072114+0000","last_clean":"2024-05-08T10:23:50.072114+0000","last_became_active":"2024-05-08T10:23:48.455943+0000","last_became_peered":"2024-05-08T10:23:48.455943+0000","last_unstale":"2024-05-08T10:23:50.072114+0000","last_undegraded":"2024-05-08T10:23:50.072114+0000","last_fullsized":"2024-05-08T10:23:50.072114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:58.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439419+0000","last_change":"2024-05-08T10:23:47.438474+0000","last_active":"2024-05-08T10:23:49.439419+0000","last_peered":"2024-05-08T10:23:49.439419+0000","last_clean":"2024-05-08T10:23:49.439419+0000","last_became_active":"2024-05-08T10:23:47.437999+0000","last_became_peered":"2024-05-08T10:23:47.437999+0000","last_unstale":"2024-05-08T10:23:49.439419+0000","last_undegraded":"2024-05-08T10:23:49.439419+0000","last_fullsized":"2024-05-08T10:23:49.439419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:03.877856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071428+0000","last_change":"2024-05-08T10:23:48.452268+0000","last_active":"2024-05-08T10:23:50.071428+0000","last_peered":"2024-05-08T10:23:50.071428+0000","last_clean":"2024-05-08T10:23:50.071428+0000","last_became_active":"2024-05-08T10:23:48.451967+0000","last_became_peered":"2024-05-08T10:23:48.451967+0000","last_unstale":"2024-05-08T10:23:50.071428+0000","last_undegraded":"2024-05-08T10:23:50.071428+0000","last_fullsized":"2024-05-08T10:23:50.071428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:52.424060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439314+0000","last_change":"2024-05-08T10:23:47.437314+0000","last_active":"2024-05-08T10:23:49.439314+0000","last_peered":"2024-05-08T10:23:49.439314+0000","last_clean":"2024-05-08T10:23:49.439314+0000","last_became_active":"2024-05-08T10:23:47.436966+0000","last_became_peered":"2024-05-08T10:23:47.436966+0000","last_unstale":"2024-05-08T10:23:49.439314+0000","last_undegraded":"2024-05-08T10:23:49.439314+0000","last_fullsized":"2024-05-08T10:23:49.439314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:19.020271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071837+0000","last_change":"2024-05-08T10:23:48.452071+0000","last_active":"2024-05-08T10:23:50.071837+0000","last_peered":"2024-05-08T10:23:50.071837+0000","last_clean":"2024-05-08T10:23:50.071837+0000","last_became_active":"2024-05-08T10:23:48.451744+0000","last_became_peered":"2024-05-08T10:23:48.451744+0000","last_unstale":"2024-05-08T10:23:50.071837+0000","last_undegraded":"2024-05-08T10:23:50.071837+0000","last_fullsized":"2024-05-08T10:23:50.071837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:31.821509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071896+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:23:50.071896+0000","last_peered":"2024-05-08T10:23:50.071896+0000","last_clean":"2024-05-08T10:23:50.071896+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:23:50.071896+0000","last_undegraded":"2024-05-08T10:23:50.071896+0000","last_fullsized":"2024-05-08T10:23:50.071896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070816+0000","last_change":"2024-05-08T10:23:47.437924+0000","last_active":"2024-05-08T10:23:50.070816+0000","last_peered":"2024-05-08T10:23:50.070816+0000","last_clean":"2024-05-08T10:23:50.070816+0000","last_became_active":"2024-05-08T10:23:47.437630+0000","last_became_peered":"2024-05-08T10:23:47.437630+0000","last_unstale":"2024-05-08T10:23:50.070816+0000","last_undegraded":"2024-05-08T10:23:50.070816+0000","last_fullsized":"2024-05-08T10:23:50.070816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071143+0000","last_change":"2024-05-08T10:23:48.454035+0000","last_active":"2024-05-08T10:23:50.071143+0000","last_peered":"2024-05-08T10:23:50.071143+0000","last_clean":"2024-05-08T10:23:50.071143+0000","last_became_active":"2024-05-08T10:23:48.453770+0000","last_became_peered":"2024-05-08T10:23:48.453770+0000","last_unstale":"2024-05-08T10:23:50.071143+0000","last_undegraded":"2024-05-08T10:23:50.071143+0000","last_fullsized":"2024-05-08T10:23:50.071143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:19.879536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071396+0000","last_change":"2024-05-08T10:23:47.442183+0000","last_active":"2024-05-08T10:23:50.071396+0000","last_peered":"2024-05-08T10:23:50.071396+0000","last_clean":"2024-05-08T10:23:50.071396+0000","last_became_active":"2024-05-08T10:23:47.441485+0000","last_became_peered":"2024-05-08T10:23:47.441485+0000","last_unstale":"2024-05-08T10:23:50.071396+0000","last_undegraded":"2024-05-08T10:23:50.071396+0000","last_fullsized":"2024-05-08T10:23:50.071396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071720+0000","last_change":"2024-05-08T10:23:48.436512+0000","last_active":"2024-05-08T10:23:50.071720+0000","last_peered":"2024-05-08T10:23:50.071720+0000","last_clean":"2024-05-08T10:23:50.071720+0000","last_became_active":"2024-05-08T10:23:48.436244+0000","last_became_peered":"2024-05-08T10:23:48.436244+0000","last_unstale":"2024-05-08T10:23:50.071720+0000","last_undegraded":"2024-05-08T10:23:50.071720+0000","last_fullsized":"2024-05-08T10:23:50.071720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:20.657051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439825+0000","last_change":"2024-05-08T10:23:47.426677+0000","last_active":"2024-05-08T10:23:49.439825+0000","last_peered":"2024-05-08T10:23:49.439825+0000","last_clean":"2024-05-08T10:23:49.439825+0000","last_became_active":"2024-05-08T10:23:47.426406+0000","last_became_peered":"2024-05-08T10:23:47.426406+0000","last_unstale":"2024-05-08T10:23:49.439825+0000","last_undegraded":"2024-05-08T10:23:49.439825+0000","last_fullsized":"2024-05-08T10:23:49.439825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439093+0000","last_change":"2024-05-08T10:23:48.442557+0000","last_active":"2024-05-08T10:23:49.439093+0000","last_peered":"2024-05-08T10:23:49.439093+0000","last_clean":"2024-05-08T10:23:49.439093+0000","last_became_active":"2024-05-08T10:23:48.442172+0000","last_became_peered":"2024-05-08T10:23:48.442172+0000","last_unstale":"2024-05-08T10:23:49.439093+0000","last_undegraded":"2024-05-08T10:23:49.439093+0000","last_fullsized":"2024-05-08T10:23:49.439093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:07:02.154406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071141+0000","last_change":"2024-05-08T10:23:47.440567+0000","last_active":"2024-05-08T10:23:50.071141+0000","last_peered":"2024-05-08T10:23:50.071141+0000","last_clean":"2024-05-08T10:23:50.071141+0000","last_became_active":"2024-05-08T10:23:47.440075+0000","last_became_peered":"2024-05-08T10:23:47.440075+0000","last_unstale":"2024-05-08T10:23:50.071141+0000","last_undegraded":"2024-05-08T10:23:50.071141+0000","last_fullsized":"2024-05-08T10:23:50.071141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440323+0000","last_change":"2024-05-08T10:23:48.440957+0000","last_active":"2024-05-08T10:23:49.440323+0000","last_peered":"2024-05-08T10:23:49.440323+0000","last_clean":"2024-05-08T10:23:49.440323+0000","last_became_active":"2024-05-08T10:23:48.440668+0000","last_became_peered":"2024-05-08T10:23:48.440668+0000","last_unstale":"2024-05-08T10:23:49.440323+0000","last_undegraded":"2024-05-08T10:23:49.440323+0000","last_fullsized":"2024-05-08T10:23:49.440323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:42.025883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439618+0000","last_change":"2024-05-08T10:23:47.439238+0000","last_active":"2024-05-08T10:23:49.439618+0000","last_peered":"2024-05-08T10:23:49.439618+0000","last_clean":"2024-05-08T10:23:49.439618+0000","last_became_active":"2024-05-08T10:23:47.438965+0000","last_became_peered":"2024-05-08T10:23:47.438965+0000","last_unstale":"2024-05-08T10:23:49.439618+0000","last_undegraded":"2024-05-08T10:23:49.439618+0000","last_fullsized":"2024-05-08T10:23:49.439618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:08.211133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071825+0000","last_change":"2024-05-08T10:23:48.449865+0000","last_active":"2024-05-08T10:23:50.071825+0000","last_peered":"2024-05-08T10:23:50.071825+0000","last_clean":"2024-05-08T10:23:50.071825+0000","last_became_active":"2024-05-08T10:23:48.449534+0000","last_became_peered":"2024-05-08T10:23:48.449534+0000","last_unstale":"2024-05-08T10:23:50.071825+0000","last_undegraded":"2024-05-08T10:23:50.071825+0000","last_fullsized":"2024-05-08T10:23:50.071825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:58.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072152+0000","last_change":"2024-05-08T10:23:47.443886+0000","last_active":"2024-05-08T10:23:50.072152+0000","last_peered":"2024-05-08T10:23:50.072152+0000","last_clean":"2024-05-08T10:23:50.072152+0000","last_became_active":"2024-05-08T10:23:47.443654+0000","last_became_peered":"2024-05-08T10:23:47.443654+0000","last_unstale":"2024-05-08T10:23:50.072152+0000","last_undegraded":"2024-05-08T10:23:50.072152+0000","last_fullsized":"2024-05-08T10:23:50.072152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:30.687087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439533+0000","last_change":"2024-05-08T10:23:48.444924+0000","last_active":"2024-05-08T10:23:49.439533+0000","last_peered":"2024-05-08T10:23:49.439533+0000","last_clean":"2024-05-08T10:23:49.439533+0000","last_became_active":"2024-05-08T10:23:48.444666+0000","last_became_peered":"2024-05-08T10:23:48.444666+0000","last_unstale":"2024-05-08T10:23:49.439533+0000","last_undegraded":"2024-05-08T10:23:49.439533+0000","last_fullsized":"2024-05-08T10:23:49.439533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439457+0000","last_change":"2024-05-08T10:23:47.440367+0000","last_active":"2024-05-08T10:23:49.439457+0000","last_peered":"2024-05-08T10:23:49.439457+0000","last_clean":"2024-05-08T10:23:49.439457+0000","last_became_active":"2024-05-08T10:23:47.440098+0000","last_became_peered":"2024-05-08T10:23:47.440098+0000","last_unstale":"2024-05-08T10:23:49.439457+0000","last_undegraded":"2024-05-08T10:23:49.439457+0000","last_fullsized":"2024-05-08T10:23:49.439457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071073+0000","last_change":"2024-05-08T10:23:48.451970+0000","last_active":"2024-05-08T10:23:50.071073+0000","last_peered":"2024-05-08T10:23:50.071073+0000","last_clean":"2024-05-08T10:23:50.071073+0000","last_became_active":"2024-05-08T10:23:48.451718+0000","last_became_peered":"2024-05-08T10:23:48.451718+0000","last_unstale":"2024-05-08T10:23:50.071073+0000","last_undegraded":"2024-05-08T10:23:50.071073+0000","last_fullsized":"2024-05-08T10:23:50.071073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:50.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070016+0000","last_change":"2024-05-08T10:23:47.441809+0000","last_active":"2024-05-08T10:23:50.070016+0000","last_peered":"2024-05-08T10:23:50.070016+0000","last_clean":"2024-05-08T10:23:50.070016+0000","last_became_active":"2024-05-08T10:23:47.441527+0000","last_became_peered":"2024-05-08T10:23:47.441527+0000","last_unstale":"2024-05-08T10:23:50.070016+0000","last_undegraded":"2024-05-08T10:23:50.070016+0000","last_fullsized":"2024-05-08T10:23:50.070016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071600+0000","last_change":"2024-05-08T10:23:48.449529+0000","last_active":"2024-05-08T10:23:50.071600+0000","last_peered":"2024-05-08T10:23:50.071600+0000","last_clean":"2024-05-08T10:23:50.071600+0000","last_became_active":"2024-05-08T10:23:48.449277+0000","last_became_peered":"2024-05-08T10:23:48.449277+0000","last_unstale":"2024-05-08T10:23:50.071600+0000","last_undegraded":"2024-05-08T10:23:50.071600+0000","last_fullsized":"2024-05-08T10:23:50.071600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:14.967250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071278+0000","last_change":"2024-05-08T10:23:47.443969+0000","last_active":"2024-05-08T10:23:50.071278+0000","last_peered":"2024-05-08T10:23:50.071278+0000","last_clean":"2024-05-08T10:23:50.071278+0000","last_became_active":"2024-05-08T10:23:47.443699+0000","last_became_peered":"2024-05-08T10:23:47.443699+0000","last_unstale":"2024-05-08T10:23:50.071278+0000","last_undegraded":"2024-05-08T10:23:50.071278+0000","last_fullsized":"2024-05-08T10:23:50.071278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.440154+0000","last_change":"2024-05-08T10:23:48.434030+0000","last_active":"2024-05-08T10:23:49.440154+0000","last_peered":"2024-05-08T10:23:49.440154+0000","last_clean":"2024-05-08T10:23:49.440154+0000","last_became_active":"2024-05-08T10:23:48.432607+0000","last_became_peered":"2024-05-08T10:23:48.432607+0000","last_unstale":"2024-05-08T10:23:49.440154+0000","last_undegraded":"2024-05-08T10:23:49.440154+0000","last_fullsized":"2024-05-08T10:23:49.440154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:49.151330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439287+0000","last_change":"2024-05-08T10:23:47.441563+0000","last_active":"2024-05-08T10:23:49.439287+0000","last_peered":"2024-05-08T10:23:49.439287+0000","last_clean":"2024-05-08T10:23:49.439287+0000","last_became_active":"2024-05-08T10:23:47.441300+0000","last_became_peered":"2024-05-08T10:23:47.441300+0000","last_unstale":"2024-05-08T10:23:49.439287+0000","last_undegraded":"2024-05-08T10:23:49.439287+0000","last_fullsized":"2024-05-08T10:23:49.439287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:48.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.070974+0000","last_change":"2024-05-08T10:23:48.447037+0000","last_active":"2024-05-08T10:23:50.070974+0000","last_peered":"2024-05-08T10:23:50.070974+0000","last_clean":"2024-05-08T10:23:50.070974+0000","last_became_active":"2024-05-08T10:23:48.446758+0000","last_became_peered":"2024-05-08T10:23:48.446758+0000","last_unstale":"2024-05-08T10:23:50.070974+0000","last_undegraded":"2024-05-08T10:23:50.070974+0000","last_fullsized":"2024-05-08T10:23:50.070974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:00.030600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:49.439217+0000","last_change":"2024-05-08T10:23:47.438095+0000","last_active":"2024-05-08T10:23:49.439217+0000","last_peered":"2024-05-08T10:23:49.439217+0000","last_clean":"2024-05-08T10:23:49.439217+0000","last_became_active":"2024-05-08T10:23:47.437623+0000","last_became_peered":"2024-05-08T10:23:47.437623+0000","last_unstale":"2024-05-08T10:23:49.439217+0000","last_undegraded":"2024-05-08T10:23:49.439217+0000","last_fullsized":"2024-05-08T10:23:49.439217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.015529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071504+0000","last_change":"2024-05-08T10:23:48.440080+0000","last_active":"2024-05-08T10:23:50.071504+0000","last_peered":"2024-05-08T10:23:50.071504+0000","last_clean":"2024-05-08T10:23:50.071504+0000","last_became_active":"2024-05-08T10:23:48.439806+0000","last_became_peered":"2024-05-08T10:23:48.439806+0000","last_unstale":"2024-05-08T10:23:50.071504+0000","last_undegraded":"2024-05-08T10:23:50.071504+0000","last_fullsized":"2024-05-08T10:23:50.071504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:53:25.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071944+0000","last_change":"2024-05-08T10:23:47.441909+0000","last_active":"2024-05-08T10:23:50.071944+0000","last_peered":"2024-05-08T10:23:50.071944+0000","last_clean":"2024-05-08T10:23:50.071944+0000","last_became_active":"2024-05-08T10:23:47.441503+0000","last_became_peered":"2024-05-08T10:23:47.441503+0000","last_unstale":"2024-05-08T10:23:50.071944+0000","last_undegraded":"2024-05-08T10:23:50.071944+0000","last_fullsized":"2024-05-08T10:23:50.071944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:03.877856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.069602+0000","last_change":"2024-05-08T10:23:48.442495+0000","last_active":"2024-05-08T10:23:50.069602+0000","last_peered":"2024-05-08T10:23:50.069602+0000","last_clean":"2024-05-08T10:23:50.069602+0000","last_became_active":"2024-05-08T10:23:48.442219+0000","last_became_peered":"2024-05-08T10:23:48.442219+0000","last_unstale":"2024-05-08T10:23:50.069602+0000","last_undegraded":"2024-05-08T10:23:50.069602+0000","last_fullsized":"2024-05-08T10:23:50.069602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:24.588992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071714+0000","last_change":"2024-05-08T10:23:48.450618+0000","last_active":"2024-05-08T10:23:50.071714+0000","last_peered":"2024-05-08T10:23:50.071714+0000","last_clean":"2024-05-08T10:23:50.071714+0000","last_became_active":"2024-05-08T10:23:48.450339+0000","last_became_peered":"2024-05-08T10:23:48.450339+0000","last_unstale":"2024-05-08T10:23:50.071714+0000","last_undegraded":"2024-05-08T10:23:50.071714+0000","last_fullsized":"2024-05-08T10:23:50.071714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:16.618080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.072177+0000","last_change":"2024-05-08T10:23:47.439945+0000","last_active":"2024-05-08T10:23:50.072177+0000","last_peered":"2024-05-08T10:23:50.072177+0000","last_clean":"2024-05-08T10:23:50.072177+0000","last_became_active":"2024-05-08T10:23:47.439631+0000","last_became_peered":"2024-05-08T10:23:47.439631+0000","last_unstale":"2024-05-08T10:23:50.072177+0000","last_undegraded":"2024-05-08T10:23:50.072177+0000","last_fullsized":"2024-05-08T10:23:50.072177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:41.023823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071282+0000","last_change":"2024-05-08T10:23:48.449884+0000","last_active":"2024-05-08T10:23:50.071282+0000","last_peered":"2024-05-08T10:23:50.071282+0000","last_clean":"2024-05-08T10:23:50.071282+0000","last_became_active":"2024-05-08T10:23:48.449628+0000","last_became_peered":"2024-05-08T10:23:48.449628+0000","last_unstale":"2024-05-08T10:23:50.071282+0000","last_undegraded":"2024-05-08T10:23:50.071282+0000","last_fullsized":"2024-05-08T10:23:50.071282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.646809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071959+0000","last_change":"2024-05-08T10:23:47.442600+0000","last_active":"2024-05-08T10:23:50.071959+0000","last_peered":"2024-05-08T10:23:50.071959+0000","last_clean":"2024-05-08T10:23:50.071959+0000","last_became_active":"2024-05-08T10:23:47.441385+0000","last_became_peered":"2024-05-08T10:23:47.441385+0000","last_unstale":"2024-05-08T10:23:50.071959+0000","last_undegraded":"2024-05-08T10:23:50.071959+0000","last_fullsized":"2024-05-08T10:23:50.071959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:08.211133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071411+0000","last_change":"2024-05-08T10:23:48.451860+0000","last_active":"2024-05-08T10:23:50.071411+0000","last_peered":"2024-05-08T10:23:50.071411+0000","last_clean":"2024-05-08T10:23:50.071411+0000","last_became_active":"2024-05-08T10:23:48.451546+0000","last_became_peered":"2024-05-08T10:23:48.451546+0000","last_unstale":"2024-05-08T10:23:50.071411+0000","last_undegraded":"2024-05-08T10:23:50.071411+0000","last_fullsized":"2024-05-08T10:23:50.071411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:57.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071239+0000","last_change":"2024-05-08T10:23:47.435845+0000","last_active":"2024-05-08T10:23:50.071239+0000","last_peered":"2024-05-08T10:23:50.071239+0000","last_clean":"2024-05-08T10:23:50.071239+0000","last_became_active":"2024-05-08T10:23:47.435557+0000","last_became_peered":"2024-05-08T10:23:47.435557+0000","last_unstale":"2024-05-08T10:23:50.071239+0000","last_undegraded":"2024-05-08T10:23:50.071239+0000","last_fullsized":"2024-05-08T10:23:50.071239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:22.028375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071173+0000","last_change":"2024-05-08T10:23:48.446164+0000","last_active":"2024-05-08T10:23:50.071173+0000","last_peered":"2024-05-08T10:23:50.071173+0000","last_clean":"2024-05-08T10:23:50.071173+0000","last_became_active":"2024-05-08T10:23:48.445903+0000","last_became_peered":"2024-05-08T10:23:48.445903+0000","last_unstale":"2024-05-08T10:23:50.071173+0000","last_undegraded":"2024-05-08T10:23:50.071173+0000","last_fullsized":"2024-05-08T10:23:50.071173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:47.415124+0000","last_clean_scrub_stamp":"2024-05-08T10:23:47.415124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:17.618922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:23:50.071638+0000","last_change":"2024-05-08T10:23:47.439956+0000","last_active":"2024-05-08T10:23:50.071638+0000","last_peered":"2024-05-08T10:23:50.071638+0000","last_clean":"2024-05-08T10:23:50.071638+0000","last_became_active":"2024-05-08T10:23:47.439661+0000","last_became_peered":"2024-05-08T10:23:47.439661+0000","last_unstale":"2024-05-08T10:23:50.071638+0000","last_undegraded":"2024-05-08T10:23:50.071638+0000","last_fullsized":"2024-05-08T10:23:50.071638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:46.413065+0000","last_clean_scrub_stamp":"2024-05-08T10:23:46.413065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:31.209656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:00.623 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T10:24:00.623 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T10:24:00.623 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T10:24:00.623 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T10:24:00.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.773+0000 7f708ceb0640 1 Processor -- start 2024-05-08T10:24:00.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.773+0000 7f708ceb0640 1 -- start start 2024-05-08T10:24:00.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708ceb0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f708815d080 0x7f7088161810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708ceb0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880b0210 0x7f7088072350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708ceb0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7088070680 con 0x7f70880701d0 2024-05-08T10:24:00.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708ceb0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7088161380 con 0x7f708815d080 2024-05-08T10:24:00.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708ceb0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f70880ae270 con 0x7f70880b0210 2024-05-08T10:24:00.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708659c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f708815d080 0x7f7088161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f707ffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f70880701d0 0x7f70880afb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39118/0 (socket says 172.21.15.143:39118) 2024-05-08T10:24:00.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f707ffff640 1 -- 172.21.15.143:0/1482956859 learned_addr learned my addr 172.21.15.143:0/1482956859 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:00.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f7086d9d640 1 --2- 172.21.15.143:0/1482956859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880b0210 0x7f7088072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708659c640 1 -- 172.21.15.143:0/1482956859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880b0210 msgr2=0x7f7088072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:00.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708659c640 1 --2- 172.21.15.143:0/1482956859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880b0210 0x7f7088072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708659c640 1 -- 172.21.15.143:0/1482956859 >> v1:172.21.15.143:6789/0 conn(0x7f70880701d0 legacy=0x7f70880afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f708659c640 1 -- 172.21.15.143:0/1482956859 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7088160d30 con 0x7f708815d080 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.774+0000 7f7085d9b640 1 -- 172.21.15.143:0/1482956859 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394502625 0 0) 0x7f7088070680 con 0x7f70880701d0 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.775+0000 7f7086d9d640 1 --2- 172.21.15.143:0/1482956859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880b0210 0x7f7088072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.775+0000 7f708659c640 1 --2- 172.21.15.143:0/1482956859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 0x7f7088161810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70780097a0 tx=0x7f707802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32011dc306b8285 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.775+0000 7f7085d9b640 1 -- 172.21.15.143:0/1482956859 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078037070 con 0x7f708815d080 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.775+0000 7f7085d9b640 1 -- 172.21.15.143:0/1482956859 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7078032440 con 0x7f708815d080 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.775+0000 7f7085d9b640 1 -- 172.21.15.143:0/1482956859 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078032810 con 0x7f708815d080 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.776+0000 7f708ceb0640 1 -- 172.21.15.143:0/1482956859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 msgr2=0x7f7088161810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.776+0000 7f708ceb0640 1 --2- 172.21.15.143:0/1482956859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 0x7f7088161810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70780097a0 tx=0x7f707802a180 comp rx=0 tx=0).stop 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.776+0000 7f708ceb0640 1 -- 172.21.15.143:0/1482956859 shutdown_connections 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.776+0000 7f708ceb0640 1 --2- 172.21.15.143:0/1482956859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880b0210 0x7f7088072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.776+0000 7f708ceb0640 1 --2- 172.21.15.143:0/1482956859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 0x7f7088161810 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.776+0000 7f708ceb0640 1 -- 172.21.15.143:0/1482956859 >> 172.21.15.143:0/1482956859 conn(0x7f70880b2bb0 msgr2=0x7f70880b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:00.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.776+0000 7f708ceb0640 1 -- 172.21.15.143:0/1482956859 shutdown_connections 2024-05-08T10:24:00.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.776+0000 7f708ceb0640 1 -- 172.21.15.143:0/1482956859 wait complete. 2024-05-08T10:24:00.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.777+0000 7f708ceb0640 1 Processor -- start 2024-05-08T10:24:00.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.777+0000 7f708ceb0640 1 -- start start 2024-05-08T10:24:00.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f708ceb0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880701d0 0x7f708815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f708ceb0640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70880b0210 0x7f708809def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f708ceb0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 0x7f70881516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f708ceb0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f708815d5e0 con 0x7f708815d080 2024-05-08T10:24:00.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f708ceb0640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f708815d460 con 0x7f70880b0210 2024-05-08T10:24:00.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f708ceb0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f70880ae550 con 0x7f70880701d0 2024-05-08T10:24:00.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f7086d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 0x7f70881516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f7086d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 0x7f70881516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36374/0 (socket says 172.21.15.143:36374) 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f7086d9d640 1 -- 172.21.15.143:0/4202179271 learned_addr learned my addr 172.21.15.143:0/4202179271 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f708659c640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880701d0 0x7f708815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f707ffff640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70880b0210 0x7f708809def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f7086d9d640 1 -- 172.21.15.143:0/4202179271 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880701d0 msgr2=0x7f708815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f7086d9d640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880701d0 0x7f708815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f7086d9d640 1 -- 172.21.15.143:0/4202179271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70880b0210 msgr2=0x7f708809def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f7086d9d640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70880b0210 0x7f708809def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f7086d9d640 1 -- 172.21.15.143:0/4202179271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70881602e0 con 0x7f708815d080 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.778+0000 7f7086d9d640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 0x7f70881516c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f708000cef0 tx=0x7f708000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.779+0000 7f707effd640 1 -- 172.21.15.143:0/4202179271 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708001a070 con 0x7f708815d080 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.779+0000 7f707effd640 1 -- 172.21.15.143:0/4202179271 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708000d860 con 0x7f708815d080 2024-05-08T10:24:00.768 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.779+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70881f6740 con 0x7f708815d080 2024-05-08T10:24:00.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.779+0000 7f707effd640 1 -- 172.21.15.143:0/4202179271 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708000dc50 con 0x7f708815d080 2024-05-08T10:24:00.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.779+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70881f6d00 con 0x7f708815d080 2024-05-08T10:24:00.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.779+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708806a4b0 con 0x7f708815d080 2024-05-08T10:24:00.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.780+0000 7f707effd640 1 -- 172.21.15.143:0/4202179271 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f708001d070 con 0x7f708815d080 2024-05-08T10:24:00.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.780+0000 7f707effd640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f70680762d0 0x7f7068078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:00.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.781+0000 7f707effd640 1 -- 172.21.15.143:0/4202179271 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7080097e60 con 0x7f708815d080 2024-05-08T10:24:00.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.781+0000 7f708659c640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f70680762d0 0x7f7068078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:00.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.781+0000 7f708659c640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f70680762d0 0x7f7068078790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7078034000 tx=0x7f707802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:00.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:00.785+0000 7f707effd640 1 -- 172.21.15.143:0/4202179271 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7080061880 con 0x7f708815d080 2024-05-08T10:24:00.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.004+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7088072910 con 0x7f708815d080 2024-05-08T10:24:00.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.004+0000 7f707effd640 1 -- 172.21.15.143:0/4202179271 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7080061180 con 0x7f708815d080 2024-05-08T10:24:00.989 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:00.990 INFO:teuthology.orchestra.run.smithi143.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T10:24:00.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f70680762d0 msgr2=0x7f7068078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f70680762d0 0x7f7068078790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7078034000 tx=0x7f707802e000 comp rx=0 tx=0).stop 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 msgr2=0x7f70881516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 0x7f70881516c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f708000cef0 tx=0x7f708000a710 comp rx=0 tx=0).stop 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 shutdown_connections 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f70680762d0 0x7f7068078790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f708815d080 0x7f70881516c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70880b0210 0x7f708809def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 --2- 172.21.15.143:0/4202179271 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f70880701d0 0x7f708815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 >> 172.21.15.143:0/4202179271 conn(0x7f70880b2bb0 msgr2=0x7f708814e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 shutdown_connections 2024-05-08T10:24:00.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.006+0000 7f708ceb0640 1 -- 172.21.15.143:0/4202179271 wait complete. 2024-05-08T10:24:01.003 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T10:24:01.003 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:01.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.118+0000 7f235f19e640 1 Processor -- start 2024-05-08T10:24:01.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.118+0000 7f235f19e640 1 -- start start 2024-05-08T10:24:01.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235f19e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23581627e0 0x7f23580b6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235f19e640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2358162bc0 0x7f23580d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235f19e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23580d2770 0x7f23580d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235f19e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f23580b4260 con 0x7f23580d2770 2024-05-08T10:24:01.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235f19e640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f23580d22e0 con 0x7f2358162bc0 2024-05-08T10:24:01.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235f19e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f23580b3f80 con 0x7f23581627e0 2024-05-08T10:24:01.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235e99d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23580d2770 0x7f23580d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235e99d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f23580d2770 0x7f23580d3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36380/0 (socket says 172.21.15.143:36380) 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235e99d640 1 -- 172.21.15.143:0/1173047791 learned_addr learned my addr 172.21.15.143:0/1173047791 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235d99b640 1 --2- 172.21.15.143:0/1173047791 >> v2:172.21.15.163:3300/0 conn(0x7f2358162bc0 0x7f23580d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235e19c640 1 --2- 172.21.15.143:0/1173047791 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23581627e0 0x7f23580b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235e99d640 1 -- 172.21.15.143:0/1173047791 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23581627e0 msgr2=0x7f23580b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235e99d640 1 --2- 172.21.15.143:0/1173047791 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23581627e0 0x7f23580b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235e99d640 1 -- 172.21.15.143:0/1173047791 >> v2:172.21.15.163:3300/0 conn(0x7f2358162bc0 msgr2=0x7f23580d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235e99d640 1 --2- 172.21.15.143:0/1173047791 >> v2:172.21.15.163:3300/0 conn(0x7f2358162bc0 0x7f23580d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235e99d640 1 -- 172.21.15.143:0/1173047791 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23580d1c90 con 0x7f23580d2770 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.119+0000 7f235d99b640 1 --2- 172.21.15.143:0/1173047791 >> v2:172.21.15.163:3300/0 conn(0x7f2358162bc0 0x7f23580d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.120+0000 7f235e99d640 1 --2- 172.21.15.143:0/1173047791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23580d2770 0x7f23580d3950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23580b7cd0 tx=0x7f235002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2103434936607343 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.120+0000 7f235d19a640 1 -- 172.21.15.143:0/1173047791 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350037070 con 0x7f23580d2770 2024-05-08T10:24:01.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.120+0000 7f235d19a640 1 -- 172.21.15.143:0/1173047791 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235002ae00 con 0x7f23580d2770 2024-05-08T10:24:01.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.120+0000 7f235d19a640 1 -- 172.21.15.143:0/1173047791 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350032660 con 0x7f23580d2770 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.120+0000 7f235f19e640 1 -- 172.21.15.143:0/1173047791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23580d2770 msgr2=0x7f23580d3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.120+0000 7f235f19e640 1 --2- 172.21.15.143:0/1173047791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23580d2770 0x7f23580d3950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23580b7cd0 tx=0x7f235002a0b0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.121+0000 7f235f19e640 1 -- 172.21.15.143:0/1173047791 shutdown_connections 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.121+0000 7f235f19e640 1 --2- 172.21.15.143:0/1173047791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23580d2770 0x7f23580d3950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.121+0000 7f235f19e640 1 --2- 172.21.15.143:0/1173047791 >> v2:172.21.15.163:3300/0 conn(0x7f2358162bc0 0x7f23580d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.121+0000 7f235f19e640 1 --2- 172.21.15.143:0/1173047791 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23581627e0 0x7f23580b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.121+0000 7f235f19e640 1 -- 172.21.15.143:0/1173047791 >> 172.21.15.143:0/1173047791 conn(0x7f235809e340 msgr2=0x7f23580d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.121+0000 7f235f19e640 1 -- 172.21.15.143:0/1173047791 shutdown_connections 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.121+0000 7f235f19e640 1 -- 172.21.15.143:0/1173047791 wait complete. 2024-05-08T10:24:01.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.122+0000 7f235f19e640 1 Processor -- start 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.122+0000 7f235f19e640 1 -- start start 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235f19e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23580d2770 0x7f23580cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235f19e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23581627e0 0x7f23580ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235f19e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2358162bc0 0x7f23580cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235f19e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f23580d3e90 con 0x7f2358162bc0 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235f19e640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f235809e8a0 con 0x7f23581627e0 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235f19e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f23580d4010 con 0x7f23580d2770 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e99d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2358162bc0 0x7f23580cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e99d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2358162bc0 0x7f23580cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36396/0 (socket says 172.21.15.143:36396) 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e99d640 1 -- 172.21.15.143:0/3869574490 learned_addr learned my addr 172.21.15.143:0/3869574490 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235d99b640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23581627e0 0x7f23580ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e19c640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23580d2770 0x7f23580cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e99d640 1 -- 172.21.15.143:0/3869574490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23580d2770 msgr2=0x7f23580cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e99d640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23580d2770 0x7f23580cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e99d640 1 -- 172.21.15.143:0/3869574490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23581627e0 msgr2=0x7f23580ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e99d640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23581627e0 0x7f23580ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e99d640 1 -- 172.21.15.143:0/3869574490 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23580b7ca0 con 0x7f2358162bc0 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e19c640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23580d2770 0x7f23580cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235e99d640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2358162bc0 0x7f23580cea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f23500090b0 tx=0x7f23500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f234effd640 1 -- 172.21.15.143:0/3869574490 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350042070 con 0x7f2358162bc0 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f234effd640 1 -- 172.21.15.143:0/3869574490 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235003e460 con 0x7f2358162bc0 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23580b7f80 con 0x7f2358162bc0 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f234effd640 1 -- 172.21.15.143:0/3869574490 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350037040 con 0x7f2358162bc0 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.123+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23580b8540 con 0x7f2358162bc0 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.124+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f235806a3d0 con 0x7f2358162bc0 2024-05-08T10:24:01.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.125+0000 7f234effd640 1 -- 172.21.15.143:0/3869574490 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f235003a040 con 0x7f2358162bc0 2024-05-08T10:24:01.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.126+0000 7f234effd640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f233c0762d0 0x7f233c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.126+0000 7f235e19c640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f233c0762d0 0x7f233c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.126+0000 7f234effd640 1 -- 172.21.15.143:0/3869574490 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f23500b7810 con 0x7f2358162bc0 2024-05-08T10:24:01.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.126+0000 7f235e19c640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f233c0762d0 0x7f233c078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f235806de70 tx=0x7f2354003a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:01.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.130+0000 7f234effd640 1 -- 172.21.15.143:0/3869574490 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2350080b20 con 0x7f2358162bc0 2024-05-08T10:24:01.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.349+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f235808f0f0 con 0x7f2358162bc0 2024-05-08T10:24:01.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.349+0000 7f234effd640 1 -- 172.21.15.143:0/3869574490 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7f2350084e20 con 0x7f2358162bc0 2024-05-08T10:24:01.334 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:01.335 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/3021671777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3021671777},{"type":"v1","addr":"172.21.15.163:6834","nonce":3021671777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2147988445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":2147988445},{"type":"v1","addr":"172.21.15.163:6835","nonce":2147988445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/4179295945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":4179295945},{"type":"v1","addr":"172.21.15.143:6836","nonce":4179295945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:23:47.784804+0000","modified":"2024-05-08T10:23:49.788119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-05-08T10:24:01.335 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 6 2024-05-08T10:24:01.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f233c0762d0 msgr2=0x7f233c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f233c0762d0 0x7f233c078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f235806de70 tx=0x7f2354003a10 comp rx=0 tx=0).stop 2024-05-08T10:24:01.336 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2358162bc0 msgr2=0x7f23580cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2358162bc0 0x7f23580cea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f23500090b0 tx=0x7f23500046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 shutdown_connections 2024-05-08T10:24:01.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f233c0762d0 0x7f233c078790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2358162bc0 0x7f23580cea20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23581627e0 0x7f23580ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 --2- 172.21.15.143:0/3869574490 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f23580d2770 0x7f23580cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 >> 172.21.15.143:0/3869574490 conn(0x7f235809e340 msgr2=0x7f23580b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:01.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 shutdown_connections 2024-05-08T10:24:01.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.351+0000 7f235f19e640 1 -- 172.21.15.143:0/3869574490 wait complete. 2024-05-08T10:24:01.348 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:01.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.463+0000 7fee63124640 1 Processor -- start 2024-05-08T10:24:01.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.463+0000 7fee63124640 1 -- start start 2024-05-08T10:24:01.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.464+0000 7fee63124640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fee5c0b3c30 0x7fee5c0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.464+0000 7fee63124640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fee5c06f4d0 0x7fee5c06f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.464+0000 7fee63124640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee5c0b4550 con 0x7fee5c071070 2024-05-08T10:24:01.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.464+0000 7fee63124640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fee5c0af690 con 0x7fee5c06f4d0 2024-05-08T10:24:01.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.464+0000 7fee63124640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fee5c15da70 con 0x7fee5c0b3c30 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.464+0000 7fee616c1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fee5c06f4d0 0x7fee5c06f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.464+0000 7fee616c1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fee5c06f4d0 0x7fee5c06f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36412/0 (socket says 172.21.15.143:36412) 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.464+0000 7fee616c1640 1 -- 172.21.15.143:0/3565217931 learned_addr learned my addr 172.21.15.143:0/3565217931 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.464+0000 7fee60ec0640 1 --2- 172.21.15.143:0/3565217931 >> v2:172.21.15.163:3300/0 conn(0x7fee5c0b3c30 0x7fee5c0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.465+0000 7fee616c1640 1 -- 172.21.15.143:0/3565217931 >> v2:172.21.15.163:3300/0 conn(0x7fee5c0b3c30 msgr2=0x7fee5c0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.465+0000 7fee616c1640 1 --2- 172.21.15.143:0/3565217931 >> v2:172.21.15.163:3300/0 conn(0x7fee5c0b3c30 0x7fee5c0b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.465+0000 7fee616c1640 1 -- 172.21.15.143:0/3565217931 >> v1:172.21.15.163:6789/0 conn(0x7fee5c071070 legacy=0x7fee5c0aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.465+0000 7fee616c1640 1 -- 172.21.15.143:0/3565217931 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c15dd50 con 0x7fee5c06f4d0 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.465+0000 7fee616c1640 1 --2- 172.21.15.143:0/3565217931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 0x7fee5c06f900 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0b7540 tx=0x7fee5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d079277b423d0288 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.465+0000 7fee5b7fe640 1 -- 172.21.15.143:0/3565217931 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54037070 con 0x7fee5c06f4d0 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.465+0000 7fee5b7fe640 1 -- 172.21.15.143:0/3565217931 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee54032440 con 0x7fee5c06f4d0 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.465+0000 7fee5b7fe640 1 -- 172.21.15.143:0/3565217931 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54032810 con 0x7fee5c06f4d0 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.466+0000 7fee63124640 1 -- 172.21.15.143:0/3565217931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 msgr2=0x7fee5c06f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.466+0000 7fee63124640 1 --2- 172.21.15.143:0/3565217931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 0x7fee5c06f900 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0b7540 tx=0x7fee5402a1e0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.466+0000 7fee63124640 1 -- 172.21.15.143:0/3565217931 shutdown_connections 2024-05-08T10:24:01.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.466+0000 7fee63124640 1 --2- 172.21.15.143:0/3565217931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 0x7fee5c06f900 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.466+0000 7fee63124640 1 --2- 172.21.15.143:0/3565217931 >> v2:172.21.15.163:3300/0 conn(0x7fee5c0b3c30 0x7fee5c0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.466+0000 7fee63124640 1 -- 172.21.15.143:0/3565217931 >> 172.21.15.143:0/3565217931 conn(0x7fee5c06d430 msgr2=0x7fee5c06d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:01.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.466+0000 7fee63124640 1 -- 172.21.15.143:0/3565217931 shutdown_connections 2024-05-08T10:24:01.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.466+0000 7fee63124640 1 -- 172.21.15.143:0/3565217931 wait complete. 2024-05-08T10:24:01.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.467+0000 7fee63124640 1 Processor -- start 2024-05-08T10:24:01.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.467+0000 7fee63124640 1 -- start start 2024-05-08T10:24:01.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee63124640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 0x7fee5c09f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee63124640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c071070 0x7fee5c160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee63124640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5c0b3c30 0x7fee5c09d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee63124640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c157b30 con 0x7fee5c06f4d0 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee63124640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c15e310 con 0x7fee5c071070 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee63124640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fee5c15d6f0 con 0x7fee5c0b3c30 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee60ec0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 0x7fee5c09f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee60ec0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 0x7fee5c09f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36428/0 (socket says 172.21.15.143:36428) 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee60ec0640 1 -- 172.21.15.143:0/3455434010 learned_addr learned my addr 172.21.15.143:0/3455434010 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee60ec0640 1 -- 172.21.15.143:0/3455434010 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5c0b3c30 msgr2=0x7fee5c09d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee5bfff640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c071070 0x7fee5c160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee60ec0640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5c0b3c30 0x7fee5c09d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee60ec0640 1 -- 172.21.15.143:0/3455434010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c071070 msgr2=0x7fee5c160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee60ec0640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c071070 0x7fee5c160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.468+0000 7fee60ec0640 1 -- 172.21.15.143:0/3455434010 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c09e0b0 con 0x7fee5c06f4d0 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.469+0000 7fee60ec0640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 0x7fee5c09f150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00ccd0 tx=0x7fee4c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:01.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.469+0000 7fee597fa640 1 -- 172.21.15.143:0/3455434010 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c003990 con 0x7fee5c06f4d0 2024-05-08T10:24:01.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.469+0000 7fee597fa640 1 -- 172.21.15.143:0/3455434010 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee4c003b30 con 0x7fee5c06f4d0 2024-05-08T10:24:01.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.469+0000 7fee597fa640 1 -- 172.21.15.143:0/3455434010 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c004020 con 0x7fee5c06f4d0 2024-05-08T10:24:01.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.469+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5c09e390 con 0x7fee5c06f4d0 2024-05-08T10:24:01.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.469+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5c09e950 con 0x7fee5c06f4d0 2024-05-08T10:24:01.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.470+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5c06a550 con 0x7fee5c06f4d0 2024-05-08T10:24:01.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.470+0000 7fee597fa640 1 -- 172.21.15.143:0/3455434010 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fee4c0041c0 con 0x7fee5c06f4d0 2024-05-08T10:24:01.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.471+0000 7fee597fa640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fee3c0762d0 0x7fee3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.471+0000 7fee5bfff640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fee3c0762d0 0x7fee3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.471+0000 7fee597fa640 1 -- 172.21.15.143:0/3455434010 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fee4c0979c0 con 0x7fee5c06f4d0 2024-05-08T10:24:01.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.471+0000 7fee5bfff640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fee3c0762d0 0x7fee3c078790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee5c15fdf0 tx=0x7fee44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:01.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.475+0000 7fee597fa640 1 -- 172.21.15.143:0/3455434010 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fee4c099e20 con 0x7fee5c06f4d0 2024-05-08T10:24:01.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.695+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee5c0af470 con 0x7fee5c06f4d0 2024-05-08T10:24:01.681 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.696+0000 7fee597fa640 1 -- 172.21.15.143:0/3455434010 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7fee4c014030 con 0x7fee5c06f4d0 2024-05-08T10:24:01.681 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:01.681 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/3021671777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3021671777},{"type":"v1","addr":"172.21.15.163:6834","nonce":3021671777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2147988445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":2147988445},{"type":"v1","addr":"172.21.15.163:6835","nonce":2147988445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/4179295945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":4179295945},{"type":"v1","addr":"172.21.15.143:6836","nonce":4179295945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:23:47.784804+0000","modified":"2024-05-08T10:23:49.788119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-05-08T10:24:01.681 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 6 2024-05-08T10:24:01.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fee3c0762d0 msgr2=0x7fee3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fee3c0762d0 0x7fee3c078790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee5c15fdf0 tx=0x7fee44009040 comp rx=0 tx=0).stop 2024-05-08T10:24:01.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 msgr2=0x7fee5c09f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 0x7fee5c09f150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00ccd0 tx=0x7fee4c00a5c0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 shutdown_connections 2024-05-08T10:24:01.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fee5c0b3c30 0x7fee5c09d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c071070 0x7fee5c160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fee3c0762d0 0x7fee3c078790 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 --2- 172.21.15.143:0/3455434010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee5c06f4d0 0x7fee5c09f150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 >> 172.21.15.143:0/3455434010 conn(0x7fee5c06d430 msgr2=0x7fee5c15e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:01.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 shutdown_connections 2024-05-08T10:24:01.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.698+0000 7fee63124640 1 -- 172.21.15.143:0/3455434010 wait complete. 2024-05-08T10:24:01.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:01.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.809+0000 7fe24686b640 1 Processor -- start 2024-05-08T10:24:01.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.809+0000 7fe24686b640 1 -- start start 2024-05-08T10:24:01.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe24686b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe2400b0810 0x7fe2400b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe24686b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 0x7fe2400b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe24686b640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2400741d0 con 0x7fe2400b0430 2024-05-08T10:24:01.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe24686b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe2400b1900 con 0x7fe2400b0810 2024-05-08T10:24:01.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe24686b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe2400b5610 con 0x7fe240070ea0 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe23f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe2400b0810 0x7fe2400b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe23f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe2400b0810 0x7fe2400b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36436/0 (socket says 172.21.15.143:36436) 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe23f7fe640 1 -- 172.21.15.143:0/3356449091 learned_addr learned my addr 172.21.15.143:0/3356449091 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe244e08640 1 --2- 172.21.15.143:0/3356449091 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 0x7fe2400b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe23f7fe640 1 -- 172.21.15.143:0/3356449091 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 msgr2=0x7fe2400b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe23f7fe640 1 --2- 172.21.15.143:0/3356449091 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 0x7fe2400b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe23f7fe640 1 -- 172.21.15.143:0/3356449091 >> v1:172.21.15.163:6789/0 conn(0x7fe2400b0430 legacy=0x7fe24015f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.810+0000 7fe23f7fe640 1 -- 172.21.15.143:0/3356449091 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2400b6fd0 con 0x7fe2400b0810 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.811+0000 7fe23f7fe640 1 --2- 172.21.15.143:0/3356449091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0810 0x7fe2400b4fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe234009870 tx=0x7fe23402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2978b334c099a0d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.811+0000 7fe23effd640 1 -- 172.21.15.143:0/3356449091 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234037070 con 0x7fe2400b0810 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.811+0000 7fe23effd640 1 -- 172.21.15.143:0/3356449091 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe234032440 con 0x7fe2400b0810 2024-05-08T10:24:01.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.811+0000 7fe23effd640 1 -- 172.21.15.143:0/3356449091 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234032810 con 0x7fe2400b0810 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.812+0000 7fe24686b640 1 -- 172.21.15.143:0/3356449091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0810 msgr2=0x7fe2400b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.812+0000 7fe24686b640 1 --2- 172.21.15.143:0/3356449091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0810 0x7fe2400b4fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe234009870 tx=0x7fe23402a130 comp rx=0 tx=0).stop 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.812+0000 7fe24686b640 1 -- 172.21.15.143:0/3356449091 shutdown_connections 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.812+0000 7fe24686b640 1 --2- 172.21.15.143:0/3356449091 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 0x7fe2400b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.812+0000 7fe24686b640 1 --2- 172.21.15.143:0/3356449091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0810 0x7fe2400b4fa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.812+0000 7fe24686b640 1 -- 172.21.15.143:0/3356449091 >> 172.21.15.143:0/3356449091 conn(0x7fe24006d430 msgr2=0x7fe24006d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.812+0000 7fe24686b640 1 -- 172.21.15.143:0/3356449091 shutdown_connections 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.812+0000 7fe24686b640 1 -- 172.21.15.143:0/3356449091 wait complete. 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.813+0000 7fe24686b640 1 Processor -- start 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.813+0000 7fe24686b640 1 -- start start 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe24686b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 0x7fe240155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe24686b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0430 0x7fe240158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe24686b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2400b0810 0x7fe24014a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe24686b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400b6db0 con 0x7fe2400b0430 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe24686b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400b6c30 con 0x7fe2400b0810 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe24686b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe2400b4170 con 0x7fe240070ea0 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0430 0x7fe240158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0430 0x7fe240158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36446/0 (socket says 172.21.15.143:36446) 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23f7fe640 1 -- 172.21.15.143:0/1578718346 learned_addr learned my addr 172.21.15.143:0/1578718346 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe244e08640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2400b0810 0x7fe24014a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23ffff640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 0x7fe240155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23f7fe640 1 -- 172.21.15.143:0/1578718346 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 msgr2=0x7fe240155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23f7fe640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 0x7fe240155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23f7fe640 1 -- 172.21.15.143:0/1578718346 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2400b0810 msgr2=0x7fe24014a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23f7fe640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2400b0810 0x7fe24014a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23f7fe640 1 -- 172.21.15.143:0/1578718346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2400cf660 con 0x7fe2400b0430 2024-05-08T10:24:01.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe244e08640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2400b0810 0x7fe24014a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:01.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23f7fe640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0430 0x7fe240158530 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe234009870 tx=0x7fe2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:01.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23cff9640 1 -- 172.21.15.143:0/1578718346 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234041020 con 0x7fe2400b0430 2024-05-08T10:24:01.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe23cff9640 1 -- 172.21.15.143:0/1578718346 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2340306c0 con 0x7fe2400b0430 2024-05-08T10:24:01.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.814+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe240156580 con 0x7fe2400b0430 2024-05-08T10:24:01.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.815+0000 7fe23cff9640 1 -- 172.21.15.143:0/1578718346 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234037040 con 0x7fe2400b0430 2024-05-08T10:24:01.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.815+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2400cf900 con 0x7fe2400b0430 2024-05-08T10:24:01.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.815+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24006a550 con 0x7fe2400b0430 2024-05-08T10:24:01.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.816+0000 7fe23cff9640 1 -- 172.21.15.143:0/1578718346 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe234044020 con 0x7fe2400b0430 2024-05-08T10:24:01.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.817+0000 7fe23cff9640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe22c0762d0 0x7fe22c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:01.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.817+0000 7fe23ffff640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe22c0762d0 0x7fe22c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:01.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.817+0000 7fe23cff9640 1 -- 172.21.15.143:0/1578718346 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2340b7ab0 con 0x7fe2400b0430 2024-05-08T10:24:01.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.817+0000 7fe23ffff640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe22c0762d0 0x7fe22c078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe230007fd0 tx=0x7fe230009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:01.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:01.821+0000 7fe23cff9640 1 -- 172.21.15.143:0/1578718346 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe23404b070 con 0x7fe2400b0430 2024-05-08T10:24:01.990 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.005+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe240073d40 con 0x7fe2400b0430 2024-05-08T10:24:01.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.006+0000 7fe23cff9640 1 -- 172.21.15.143:0/1578718346 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fe234081410 con 0x7fe2400b0430 2024-05-08T10:24:01.991 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:01.991 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:49.433403+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:23:45.992622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:23:46.737514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:01.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe22c0762d0 msgr2=0x7fe22c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe22c0762d0 0x7fe22c078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe230007fd0 tx=0x7fe230009040 comp rx=0 tx=0).stop 2024-05-08T10:24:01.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0430 msgr2=0x7fe240158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:01.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0430 0x7fe240158530 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe234009870 tx=0x7fe2340046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 shutdown_connections 2024-05-08T10:24:01.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2400b0810 0x7fe24014a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe22c0762d0 0x7fe22c078790 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2400b0430 0x7fe240158530 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 --2- 172.21.15.143:0/1578718346 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe240070ea0 0x7fe240155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:01.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 >> 172.21.15.143:0/1578718346 conn(0x7fe24006d430 msgr2=0x7fe24006f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:01.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 shutdown_connections 2024-05-08T10:24:01.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.008+0000 7fe24686b640 1 -- 172.21.15.143:0/1578718346 wait complete. 2024-05-08T10:24:02.005 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:02.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.120+0000 7f042e8d3640 1 Processor -- start 2024-05-08T10:24:02.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.120+0000 7f042e8d3640 1 -- start start 2024-05-08T10:24:02.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.120+0000 7f042e8d3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f042815c150 0x7f04280702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.120+0000 7f042e8d3640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0428070d80 0x7f04280b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.120+0000 7f042e8d3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f042815c530 con 0x7f04280b4170 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.120+0000 7f042e8d3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f04280b4fa0 con 0x7f042815c150 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.120+0000 7f042e8d3640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f04280b0790 con 0x7f0428070d80 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f0427fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f042815c150 0x7f04280702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f0427fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f042815c150 0x7f04280702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36448/0 (socket says 172.21.15.143:36448) 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f042ce70640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f04280b4170 0x7f04280734a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:39122/0 (socket says 172.21.15.143:39122) 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f0427fff640 1 -- 172.21.15.143:0/1249362946 learned_addr learned my addr 172.21.15.143:0/1249362946 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f041ffff640 1 --2- 172.21.15.143:0/1249362946 >> v2:172.21.15.163:3300/0 conn(0x7f0428070d80 0x7f04280b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f0427fff640 1 -- 172.21.15.143:0/1249362946 >> v2:172.21.15.163:3300/0 conn(0x7f0428070d80 msgr2=0x7f04280b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f0427fff640 1 --2- 172.21.15.143:0/1249362946 >> v2:172.21.15.163:3300/0 conn(0x7f0428070d80 0x7f04280b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f0427fff640 1 -- 172.21.15.143:0/1249362946 >> v1:172.21.15.143:6789/0 conn(0x7f04280b4170 legacy=0x7f04280734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f0427fff640 1 -- 172.21.15.143:0/1249362946 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04280b0a70 con 0x7f042815c150 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.121+0000 7f04277fe640 1 -- 172.21.15.143:0/1249362946 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294767977 0 0) 0x7f042815c530 con 0x7f04280b4170 2024-05-08T10:24:02.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f0427fff640 1 --2- 172.21.15.143:0/1249362946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f042815c150 0x7f04280702c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04280746e0 tx=0x7f041802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25082a3261f471bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f04277fe640 1 -- 172.21.15.143:0/1249362946 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418037070 con 0x7f042815c150 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f04277fe640 1 -- 172.21.15.143:0/1249362946 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0418032440 con 0x7f042815c150 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f04277fe640 1 -- 172.21.15.143:0/1249362946 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418032810 con 0x7f042815c150 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f042e8d3640 1 -- 172.21.15.143:0/1249362946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f042815c150 msgr2=0x7f04280702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f042e8d3640 1 --2- 172.21.15.143:0/1249362946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f042815c150 0x7f04280702c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04280746e0 tx=0x7f041802a270 comp rx=0 tx=0).stop 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f042e8d3640 1 -- 172.21.15.143:0/1249362946 shutdown_connections 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f042e8d3640 1 --2- 172.21.15.143:0/1249362946 >> v2:172.21.15.163:3300/0 conn(0x7f0428070d80 0x7f04280b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f042e8d3640 1 --2- 172.21.15.143:0/1249362946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f042815c150 0x7f04280702c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f042e8d3640 1 -- 172.21.15.143:0/1249362946 >> 172.21.15.143:0/1249362946 conn(0x7f042806d430 msgr2=0x7f042806d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f042e8d3640 1 -- 172.21.15.143:0/1249362946 shutdown_connections 2024-05-08T10:24:02.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.122+0000 7f042e8d3640 1 -- 172.21.15.143:0/1249362946 wait complete. 2024-05-08T10:24:02.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.123+0000 7f042e8d3640 1 Processor -- start 2024-05-08T10:24:02.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f042e8d3640 1 -- start start 2024-05-08T10:24:02.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f042e8d3640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0428070d80 0x7f0428150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f042e8d3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04280b4170 0x7f04281535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f042e8d3640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f042815c150 0x7f0428157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f042e8d3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0428070800 con 0x7f04280b4170 2024-05-08T10:24:02.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f042e8d3640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f04280b51f0 con 0x7f042815c150 2024-05-08T10:24:02.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f042e8d3640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f04280b6720 con 0x7f0428070d80 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f041ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04280b4170 0x7f04281535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f041ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04280b4170 0x7f04281535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36464/0 (socket says 172.21.15.143:36464) 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.124+0000 7f041ffff640 1 -- 172.21.15.143:0/3329497311 learned_addr learned my addr 172.21.15.143:0/3329497311 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f042ce70640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f042815c150 0x7f0428157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f0427fff640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0428070d80 0x7f0428150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f041ffff640 1 -- 172.21.15.143:0/3329497311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0428070d80 msgr2=0x7f0428150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f041ffff640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0428070d80 0x7f0428150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f041ffff640 1 -- 172.21.15.143:0/3329497311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f042815c150 msgr2=0x7f0428157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f041ffff640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f042815c150 0x7f0428157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f041ffff640 1 -- 172.21.15.143:0/3329497311 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04281540b0 con 0x7f04280b4170 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f042ce70640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f042815c150 0x7f0428157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f041ffff640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04280b4170 0x7f04281535f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f041000e980 tx=0x7f041000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f04257fa640 1 -- 172.21.15.143:0/3329497311 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410017070 con 0x7f04280b4170 2024-05-08T10:24:02.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f04257fa640 1 -- 172.21.15.143:0/3329497311 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041000ca00 con 0x7f04280b4170 2024-05-08T10:24:02.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0428154390 con 0x7f04280b4170 2024-05-08T10:24:02.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f04257fa640 1 -- 172.21.15.143:0/3329497311 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041000cdd0 con 0x7f04280b4170 2024-05-08T10:24:02.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.125+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0428154950 con 0x7f04280b4170 2024-05-08T10:24:02.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.126+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f042806a550 con 0x7f04280b4170 2024-05-08T10:24:02.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.126+0000 7f04257fa640 1 -- 172.21.15.143:0/3329497311 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f041001a070 con 0x7f04280b4170 2024-05-08T10:24:02.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.127+0000 7f04257fa640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f04080762d0 0x7f0408078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.127+0000 7f0427fff640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f04080762d0 0x7f0408078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.127+0000 7f04257fa640 1 -- 172.21.15.143:0/3329497311 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0410097980 con 0x7f04280b4170 2024-05-08T10:24:02.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.127+0000 7f0427fff640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f04080762d0 0x7f0408078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0418034000 tx=0x7f041802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.131+0000 7f04257fa640 1 -- 172.21.15.143:0/3329497311 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0410061370 con 0x7f04280b4170 2024-05-08T10:24:02.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.352+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f042806f5d0 con 0x7f04280b4170 2024-05-08T10:24:02.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.353+0000 7f04257fa640 1 -- 172.21.15.143:0/3329497311 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7f0410067070 con 0x7f04280b4170 2024-05-08T10:24:02.338 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:02.338 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/3021671777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3021671777},{"type":"v1","addr":"172.21.15.163:6834","nonce":3021671777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2147988445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":2147988445},{"type":"v1","addr":"172.21.15.163:6835","nonce":2147988445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/4179295945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":4179295945},{"type":"v1","addr":"172.21.15.143:6836","nonce":4179295945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:23:47.784804+0000","modified":"2024-05-08T10:23:49.788119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-05-08T10:24:02.339 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 6 2024-05-08T10:24:02.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f04080762d0 msgr2=0x7f0408078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f04080762d0 0x7f0408078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0418034000 tx=0x7f041802e000 comp rx=0 tx=0).stop 2024-05-08T10:24:02.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04280b4170 msgr2=0x7f04281535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04280b4170 0x7f04281535f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f041000e980 tx=0x7f041000ee40 comp rx=0 tx=0).stop 2024-05-08T10:24:02.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 shutdown_connections 2024-05-08T10:24:02.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f042815c150 0x7f0428157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f04080762d0 0x7f0408078790 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04280b4170 0x7f04281535f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 --2- 172.21.15.143:0/3329497311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0428070d80 0x7f0428150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 >> 172.21.15.143:0/3329497311 conn(0x7f042806d430 msgr2=0x7f04280d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:02.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 shutdown_connections 2024-05-08T10:24:02.341 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.355+0000 7f042e8d3640 1 -- 172.21.15.143:0/3329497311 wait complete. 2024-05-08T10:24:02.754 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T10:23:47.784804+0000', 'modified': '2024-05-08T10:23:49.788119+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6837/3340158570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6835', 'nonce': 3340158570}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 3340158570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4263, 'qdb_cluster': [4263]} 2024-05-08T10:24:02.754 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T10:24:02.754 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-08T10:24:02.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.872+0000 7f45ab7e5640 1 Processor -- start 2024-05-08T10:24:02.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.873+0000 7f45ab7e5640 1 -- start start 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.873+0000 7f45ab7e5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f770 0x7f45a40d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.873+0000 7f45ab7e5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45a40baf70 0x7f45a40d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.873+0000 7f45ab7e5640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a4163f40 con 0x7f45a415f390 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.873+0000 7f45ab7e5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f45a40d4f20 con 0x7f45a40baf70 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.873+0000 7f45ab7e5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f45a4163980 con 0x7f45a415f770 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a9d82640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45a40baf70 0x7f45a40d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a9d82640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45a40baf70 0x7f45a40d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36470/0 (socket says 172.21.15.143:36470) 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a9d82640 1 -- 172.21.15.143:0/2087438895 learned_addr learned my addr 172.21.15.143:0/2087438895 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a8d80640 1 --2- 172.21.15.143:0/2087438895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f770 0x7f45a40d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a9d82640 1 -- 172.21.15.143:0/2087438895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f770 msgr2=0x7f45a40d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a9d82640 1 --2- 172.21.15.143:0/2087438895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f770 0x7f45a40d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a9d82640 1 -- 172.21.15.143:0/2087438895 >> v1:172.21.15.163:6789/0 conn(0x7f45a415f390 legacy=0x7f45a4163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a9d82640 1 -- 172.21.15.143:0/2087438895 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a4163c60 con 0x7f45a40baf70 2024-05-08T10:24:02.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a8d80640 1 --2- 172.21.15.143:0/2087438895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f770 0x7f45a40d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:02.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.874+0000 7f45a9d82640 1 --2- 172.21.15.143:0/2087438895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a40baf70 0x7f45a40d05b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f45a40cc300 tx=0x7f459c02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4aac6573cdf345e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f459bfff640 1 -- 172.21.15.143:0/2087438895 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c036070 con 0x7f45a40baf70 2024-05-08T10:24:02.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f459bfff640 1 -- 172.21.15.143:0/2087438895 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c031600 con 0x7f45a40baf70 2024-05-08T10:24:02.861 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f459bfff640 1 -- 172.21.15.143:0/2087438895 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c02ae60 con 0x7f45a40baf70 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f45ab7e5640 1 -- 172.21.15.143:0/2087438895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a40baf70 msgr2=0x7f45a40d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f45ab7e5640 1 --2- 172.21.15.143:0/2087438895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a40baf70 0x7f45a40d05b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f45a40cc300 tx=0x7f459c02a640 comp rx=0 tx=0).stop 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f45ab7e5640 1 -- 172.21.15.143:0/2087438895 shutdown_connections 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f45ab7e5640 1 --2- 172.21.15.143:0/2087438895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a40baf70 0x7f45a40d05b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f45ab7e5640 1 --2- 172.21.15.143:0/2087438895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f770 0x7f45a40d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f45ab7e5640 1 -- 172.21.15.143:0/2087438895 >> 172.21.15.143:0/2087438895 conn(0x7f45a406d300 msgr2=0x7f45a406d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f45ab7e5640 1 -- 172.21.15.143:0/2087438895 shutdown_connections 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.875+0000 7f45ab7e5640 1 -- 172.21.15.143:0/2087438895 wait complete. 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.876+0000 7f45ab7e5640 1 Processor -- start 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.876+0000 7f45ab7e5640 1 -- start start 2024-05-08T10:24:02.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45ab7e5640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45a40baf70 0x7f45a415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45ab7e5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f390 0x7f45a40c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45ab7e5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a415f770 0x7f45a40cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45ab7e5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40b83d0 con 0x7f45a415f770 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45ab7e5640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40d39f0 con 0x7f45a40baf70 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45ab7e5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f45a40b8550 con 0x7f45a415f390 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45a9d82640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a415f770 0x7f45a40cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45a9d82640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a415f770 0x7f45a40cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36478/0 (socket says 172.21.15.143:36478) 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45a9d82640 1 -- 172.21.15.143:0/3236817481 learned_addr learned my addr 172.21.15.143:0/3236817481 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45a9d82640 1 -- 172.21.15.143:0/3236817481 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f390 msgr2=0x7f45a40c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45a8d80640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f390 0x7f45a40c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.877+0000 7f45a9581640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45a40baf70 0x7f45a415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f45a9d82640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f390 0x7f45a40c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f45a9d82640 1 -- 172.21.15.143:0/3236817481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45a40baf70 msgr2=0x7f45a415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f45a9d82640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45a40baf70 0x7f45a415a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f45a9d82640 1 -- 172.21.15.143:0/3236817481 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40cb590 con 0x7f45a415f770 2024-05-08T10:24:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f45a9581640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45a40baf70 0x7f45a415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f45a9d82640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a415f770 0x7f45a40cf8d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f459c009f40 tx=0x7f459c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f4599ffb640 1 -- 172.21.15.143:0/3236817481 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c041020 con 0x7f45a415f770 2024-05-08T10:24:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f4599ffb640 1 -- 172.21.15.143:0/3236817481 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c02ae60 con 0x7f45a415f770 2024-05-08T10:24:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f45ab7e5640 1 -- 172.21.15.143:0/3236817481 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a40caa10 con 0x7f45a415f770 2024-05-08T10:24:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f4599ffb640 1 -- 172.21.15.143:0/3236817481 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c036040 con 0x7f45a415f770 2024-05-08T10:24:02.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.878+0000 7f45ab7e5640 1 -- 172.21.15.143:0/3236817481 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a40cafd0 con 0x7f45a415f770 2024-05-08T10:24:02.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.880+0000 7f4599ffb640 1 -- 172.21.15.143:0/3236817481 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f459c044020 con 0x7f45a415f770 2024-05-08T10:24:02.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.880+0000 7f4599ffb640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45880762d0 0x7f4588078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.873 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.880+0000 7f45a9581640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45880762d0 0x7f4588078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.880+0000 7f4599ffb640 1 -- 172.21.15.143:0/3236817481 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f459c0b8240 con 0x7f45a415f770 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.881+0000 7f45a9581640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45880762d0 0x7f4588078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f45a0003eb0 tx=0x7f45a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.881+0000 7f45ae5d6740 1 Processor -- start 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.881+0000 7f45ae5d6740 1 -- start start 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1dec760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1decca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1dbcbb0 0x5573d1dc03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5573d1d268d0 con 0x5573d1de9f50 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5573d1cdfc10 con 0x5573d1dbcbb0 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x5573d1d22890 con 0x5573d1dea330 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9581640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1dec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9581640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1dec760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36484/0 (socket says 172.21.15.143:36484) 2024-05-08T10:24:02.874 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9581640 1 -- 172.21.15.143:0/3335568164 learned_addr learned my addr 172.21.15.143:0/3335568164 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9d82640 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1dbcbb0 0x5573d1dc03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a8d80640 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1decca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9581640 1 -- 172.21.15.143:0/3335568164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 msgr2=0x5573d1decca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9581640 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1decca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9581640 1 -- 172.21.15.143:0/3335568164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1dbcbb0 msgr2=0x5573d1dc03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9581640 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1dbcbb0 0x5573d1dc03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9581640 1 -- 172.21.15.143:0/3335568164 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d1ce75d0 con 0x5573d1de9f50 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9d82640 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1dbcbb0 0x5573d1dc03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f45a9581640 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1dec760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45a0003c90 tx=0x7f45a0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcac8c12d591889 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f458effd640 1 -- 172.21.15.143:0/3335568164 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0024070 con 0x5573d1de9f50 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f458effd640 1 -- 172.21.15.143:0/3335568164 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a0014db0 con 0x5573d1de9f50 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.882+0000 7f458effd640 1 -- 172.21.15.143:0/3335568164 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a001f640 con 0x5573d1de9f50 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3335568164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 msgr2=0x5573d1dec760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.875 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1dec760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45a0003c90 tx=0x7f45a0010000 comp rx=0 tx=0).stop 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3335568164 shutdown_connections 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1dbcbb0 0x5573d1dc03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1decca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3335568164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1dec760 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3335568164 >> 172.21.15.143:0/3335568164 conn(0x5573d1dbee20 msgr2=0x5573d1e07760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3335568164 shutdown_connections 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3335568164 wait complete. 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 -- start start 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.883+0000 7f45ae5d6740 1 Processor -- start 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1e0a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1e1af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1e0af00 0x5573d1e1b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5573d1dc1fd0 con 0x5573d1de9f50 2024-05-08T10:24:02.876 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5573d1ce3760 con 0x5573d1e0af00 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x5573d1dc22b0 con 0x5573d1dea330 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45ae5d6740 10 client.0 _ll_register_callbacks cb 0x5573d1d1ccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45a9581640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1e0a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45a9581640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1e0a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36490/0 (socket says 172.21.15.143:36490) 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.884+0000 7f45a9581640 1 -- 172.21.15.143:0/3309389454 learned_addr learned my addr 172.21.15.143:0/3309389454 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45a8d80640 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1e1af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45a9d82640 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1e0af00 0x5573d1e1b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45a9581640 1 -- 172.21.15.143:0/3309389454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 msgr2=0x5573d1e1af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45a9581640 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1e1af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45a9581640 1 -- 172.21.15.143:0/3309389454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1e0af00 msgr2=0x5573d1e1b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45a9581640 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1e0af00 0x5573d1e1b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45a9581640 1 -- 172.21.15.143:0/3309389454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d1a382d0 con 0x5573d1de9f50 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45a9581640 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1e0a9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009010 tx=0x7f45a00036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09d0b07aa0d6d24 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f4583fff640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2024-05-08T10:24:02.877 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f4583fff640 1 -- 172.21.15.143:0/3309389454 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0024040 con 0x5573d1de9f50 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f4583fff640 1 -- 172.21.15.143:0/3309389454 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f45a0007470 con 0x5573d1de9f50 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3309389454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45a0014db0 con 0x5573d1de9f50 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f4583fff640 1 -- 172.21.15.143:0/3309389454 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f45a0037050 con 0x5573d1de9f50 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45ae5d6740 10 client.4593 fetch_fsmap learned FSMap version 6 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3309389454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5573d1b026b0 con 0x5573d1de9f50 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f4583fff640 1 -- 172.21.15.143:0/3309389454 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a0014db0 con 0x5573d1de9f50 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f4583fff640 1 -- 172.21.15.143:0/3309389454 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f45a003a020 con 0x5573d1de9f50 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45ae5d6740 10 client.4593 fetch_fsmap finished waiting for FSMap version 6 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45ae5d6740 10 client.4593 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45ae5d6740 20 client.4593 populate_metadata read hostname 'smithi143' 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.885+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] conn(0x5573d1ded870 0x5573d1dedc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.886+0000 7f45ae5d6740 4 client.4593 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T10:24:02.878 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.886+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3309389454 --> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573d1caa760 con 0x5573d1ded870 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.886+0000 7f45a8d80640 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] conn(0x5573d1ded870 0x5573d1dedc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.886+0000 7f4583fff640 10 client.4593 ms_handle_connect on v2:172.21.15.143:6835/3340158570 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.886+0000 7f45a8d80640 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] conn(0x5573d1ded870 0x5573d1dedc50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0d4f423967f7f56 server_cookie=c0eb0d550bc7aff2 in_seq=0 out_seq=0 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f4583fff640 1 -- 172.21.15.143:0/3309389454 <== mds.0 v2:172.21.15.143:6835/3340158570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5573d1caa760 con 0x5573d1ded870 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f4583fff640 10 client.4593 handle_command_reply: tid=0 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 client.4593 shutdown 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3309389454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 msgr2=0x5573d1e0a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1e0a9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009010 tx=0x7f45a00036f0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3309389454 shutdown_connections 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] conn(0x5573d1ded870 0x5573d1dedc50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1e0af00 0x5573d1e1b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.879 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1e1af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f4583fff640 0 client.4593 ms_handle_reset on v2:172.21.15.143:6835/3340158570 2024-05-08T10:24:02.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/3309389454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1de9f50 0x5573d1e0a9c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3309389454 >> 172.21.15.143:0/3309389454 conn(0x5573d1dbcbb0 msgr2=0x5573d1dc1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:02.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3309389454 shutdown_connections 2024-05-08T10:24:02.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 1 -- 172.21.15.143:0/3309389454 wait complete. 2024-05-08T10:24:02.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.887+0000 7f45ae5d6740 20 client.4593 trim_cache size 0 max 16384 2024-05-08T10:24:02.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.905+0000 7f45ae5d6740 1 Processor -- start 2024-05-08T10:24:02.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.905+0000 7f45ae5d6740 1 -- start start 2024-05-08T10:24:02.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 0x5573d1e0b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1e1aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1e0af00 0x5573d1e1b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40ce060 con 0x5573d1e0af00 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40cd3c0 con 0x5573d1de9f50 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f45a40cda10 con 0x5573d1dea330 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a9d82640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1e0af00 0x5573d1e1b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a9d82640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1e0af00 0x5573d1e1b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36500/0 (socket says 172.21.15.143:36500) 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a9d82640 1 -- 172.21.15.143:0/2367518843 learned_addr learned my addr 172.21.15.143:0/2367518843 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a9581640 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 0x5573d1e0b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a8d80640 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1e1aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a9d82640 1 -- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 msgr2=0x5573d1e1aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a9d82640 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1e1aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a9d82640 1 -- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 msgr2=0x5573d1e0b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a9d82640 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 0x5573d1e0b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.906+0000 7f45a9d82640 1 -- 172.21.15.143:0/2367518843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d1de8120 con 0x5573d1e0af00 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45a9581640 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 0x5573d1e0b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45a8d80640 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1e1aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45a9d82640 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1e0af00 0x5573d1e1b3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f459c07e710 tx=0x7f459c080c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e85cf29cbd4a7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f458e7fc640 1 -- 172.21.15.143:0/2367518843 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c0b8070 con 0x5573d1e0af00 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f458e7fc640 1 -- 172.21.15.143:0/2367518843 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c081ba0 con 0x5573d1e0af00 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f458e7fc640 1 -- 172.21.15.143:0/2367518843 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c0b6dd0 con 0x5573d1e0af00 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45ae5d6740 1 -- 172.21.15.143:0/2367518843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1e0af00 msgr2=0x5573d1e1b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1e0af00 0x5573d1e1b3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f459c07e710 tx=0x7f459c080c10 comp rx=0 tx=0).stop 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45ae5d6740 1 -- 172.21.15.143:0/2367518843 shutdown_connections 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1e0af00 0x5573d1e1b3f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1dea330 0x5573d1e1aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/2367518843 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 0x5573d1e0b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.907+0000 7f45ae5d6740 1 -- 172.21.15.143:0/2367518843 >> 172.21.15.143:0/2367518843 conn(0x5573d1dbcbb0 msgr2=0x5573d1de0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:02.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.908+0000 7f45ae5d6740 1 -- 172.21.15.143:0/2367518843 shutdown_connections 2024-05-08T10:24:02.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.908+0000 7f45ae5d6740 1 -- 172.21.15.143:0/2367518843 wait complete. 2024-05-08T10:24:02.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.908+0000 7f45ae5d6740 1 -- start start 2024-05-08T10:24:02.896 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.908+0000 7f45ae5d6740 1 Processor -- start 2024-05-08T10:24:02.899 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 0x5573d1e0e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1dea330 0x5573d1dfd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45ae5d6740 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1e0af00 0x5573d1dfdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5573d1e08db0 con 0x5573d1dea330 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5573d1dc1fd0 con 0x5573d1de9f50 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45ae5d6740 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x5573d1def4f0 con 0x5573d1e0af00 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45ae5d6740 10 client.0 _ll_register_callbacks cb 0x7f45a0022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45a8d80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1dea330 0x5573d1dfd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45a8d80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1dea330 0x5573d1dfd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:36504/0 (socket says 172.21.15.143:36504) 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45a8d80640 1 -- 172.21.15.143:0/1934907081 learned_addr learned my addr 172.21.15.143:0/1934907081 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45a8d80640 1 -- 172.21.15.143:0/1934907081 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1e0af00 msgr2=0x5573d1dfdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45a8d80640 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1e0af00 0x5573d1dfdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45a8d80640 1 -- 172.21.15.143:0/1934907081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 msgr2=0x5573d1e0e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:02.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45a8d80640 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 0x5573d1e0e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.909+0000 7f45a8d80640 1 -- 172.21.15.143:0/1934907081 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d1e0a920 con 0x5573d1dea330 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45a8d80640 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1dea330 0x5573d1dfd860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45a40b8140 tx=0x7f459400df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afed6f79dab068ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f4583fff640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f4583fff640 1 -- 172.21.15.143:0/1934907081 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459401f070 con 0x5573d1dea330 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f4583fff640 1 -- 172.21.15.143:0/1934907081 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f459401b220 con 0x5573d1dea330 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45ae5d6740 1 -- 172.21.15.143:0/1934907081 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f459c081ba0 con 0x5573d1dea330 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f4583fff640 1 -- 172.21.15.143:0/1934907081 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f459402c050 con 0x5573d1dea330 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45ae5d6740 10 client.4599 fetch_fsmap learned FSMap version 6 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45ae5d6740 1 -- 172.21.15.143:0/1934907081 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5573d1e0e660 con 0x5573d1dea330 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f4583fff640 1 -- 172.21.15.143:0/1934907081 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c081ba0 con 0x5573d1dea330 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f4583fff640 1 -- 172.21.15.143:0/1934907081 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f459402f020 con 0x5573d1dea330 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45ae5d6740 10 client.4599 fetch_fsmap finished waiting for FSMap version 6 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45ae5d6740 10 client.4599 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T10:24:02.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45ae5d6740 20 client.4599 populate_metadata read hostname 'smithi143' 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] conn(0x5573d1e2a370 0x5573d1e2a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45ae5d6740 4 client.4599 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45ae5d6740 1 -- 172.21.15.143:0/1934907081 --> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] -- command(tid 0: {"prefix": "status"}) -- 0x5573d1d344e0 con 0x5573d1e2a370 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f45a9581640 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] conn(0x5573d1e2a370 0x5573d1e2a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.910+0000 7f4583fff640 10 client.4599 ms_handle_connect on v2:172.21.15.143:6835/3340158570 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45a9581640 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] conn(0x5573d1e2a370 0x5573d1e2a750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c1b661b052ca978 server_cookie=1151e7ddeb53f397 in_seq=0 out_seq=0 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f4583fff640 1 -- 172.21.15.143:0/1934907081 <== mds.0 v2:172.21.15.143:6835/3340158570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5573d1d344e0 con 0x5573d1e2a370 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f4583fff640 10 client.4599 handle_command_reply: tid=0 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 client.4599 shutdown 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 -- 172.21.15.143:0/1934907081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1dea330 msgr2=0x5573d1dfd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1dea330 0x5573d1dfd860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45a40b8140 tx=0x7f459400df10 comp rx=0 tx=0).stop 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 -- 172.21.15.143:0/1934907081 shutdown_connections 2024-05-08T10:24:02.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.143:6835/3340158570,v1:172.21.15.143:6837/3340158570] conn(0x5573d1e2a370 0x5573d1e2a750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5573d1e0af00 0x5573d1dfdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f4583fff640 0 client.4599 ms_handle_reset on v2:172.21.15.143:6835/3340158570 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5573d1dea330 0x5573d1dfd860 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 --2- 172.21.15.143:0/1934907081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573d1de9f50 0x5573d1e0e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 -- 172.21.15.143:0/1934907081 >> 172.21.15.143:0/1934907081 conn(0x5573d1dbcbb0 msgr2=0x5573d1e04ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 -- 172.21.15.143:0/1934907081 shutdown_connections 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 1 -- 172.21.15.143:0/1934907081 wait complete. 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.911+0000 7f45ae5d6740 20 client.4599 trim_cache size 0 max 16384 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:02.903 INFO:teuthology.orchestra.run.smithi143.stdout: "cluster_fsid": "aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64", 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "whoami": 0, 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 4263, 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "want_state": "up:active", 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "state": "up:active", 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs", 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "rank_uptime": 14.490550504, 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "mdsmap_epoch": 6, 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch": 20, 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch_barrier": 20, 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout: "uptime": 20.155493575000001 2024-05-08T10:24:02.904 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:02.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 -- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45880762d0 msgr2=0x7f4588078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45880762d0 0x7f4588078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f45a0003eb0 tx=0x7f45a0009040 comp rx=0 tx=0).stop 2024-05-08T10:24:02.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 -- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a415f770 msgr2=0x7f45a40cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:02.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a415f770 0x7f45a40cf8d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f459c009f40 tx=0x7f459c004a40 comp rx=0 tx=0).stop 2024-05-08T10:24:02.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 -- 172.21.15.143:0/3236817481 shutdown_connections 2024-05-08T10:24:02.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45880762d0 0x7f4588078790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45a415f770 0x7f45a40cf8d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45a415f390 0x7f45a40c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 --2- 172.21.15.143:0/3236817481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45a40baf70 0x7f45a415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:02.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 -- 172.21.15.143:0/3236817481 >> 172.21.15.143:0/3236817481 conn(0x7f45a406d300 msgr2=0x7f45a406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:02.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 -- 172.21.15.143:0/3236817481 shutdown_connections 2024-05-08T10:24:02.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:02.912+0000 7f45ab7e5640 1 -- 172.21.15.143:0/3236817481 wait complete. 2024-05-08T10:24:02.908 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T10:24:02.917 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T10:24:02.917 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T10:24:02.917 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T10:24:02.918 INFO:teuthology.run_tasks:Running task kclient... 2024-05-08T10:24:02.949 INFO:tasks.kclient:Mounting kernel clients... 2024-05-08T10:24:02.949 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-08T10:24:02.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:02.949 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-05-08T10:24:02.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:02.966 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-05-08T10:24:03.033 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2024-05-08T10:24:03.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:24:03.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:03.035 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-05-08T10:24:03.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:03.091 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-05-08T10:24:03.156 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2024-05-08T10:24:03.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:24:03.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:03.158 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-05-08T10:24:03.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:03.177 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2024-05-08T10:24:03.251 INFO:teuthology.orchestra.run.smithi163.stderr:Cannot find device "ceph-brx" 2024-05-08T10:24:03.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:24:03.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:03.252 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-05-08T10:24:03.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:03.312 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2024-05-08T10:24:03.380 INFO:teuthology.orchestra.run.smithi163.stderr:Cannot find device "ceph-brx" 2024-05-08T10:24:03.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:24:03.382 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-08T10:24:03.382 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T10:24:03.382 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:03.383 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:24:03.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.499+0000 7fc432e45640 1 Processor -- start 2024-05-08T10:24:03.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.499+0000 7fc432e45640 1 -- start start 2024-05-08T10:24:03.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc432e45640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc42c0b0210 0x7fc42c161810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc432e45640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 0x7fc42c072350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc432e45640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc42c0ae270 con 0x7fc42c15d080 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc432e45640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc42c161380 con 0x7fc42c0b0210 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc432e45640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc42c160d30 con 0x7fc42c0701d0 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc423fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc42c0b0210 0x7fc42c161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc423fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc42c0b0210 0x7fc42c161810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40386/0 (socket says 172.21.15.143:40386) 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc430be1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc42c15d080 0x7fc42c0afb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:50318/0 (socket says 172.21.15.143:50318) 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc423fff640 1 -- 172.21.15.143:0/1599974077 learned_addr learned my addr 172.21.15.143:0/1599974077 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc423fff640 1 -- 172.21.15.143:0/1599974077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 msgr2=0x7fc42c072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc4313e2640 1 --2- 172.21.15.143:0/1599974077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 0x7fc42c072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc423fff640 1 --2- 172.21.15.143:0/1599974077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 0x7fc42c072350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc423fff640 1 -- 172.21.15.143:0/1599974077 >> v1:172.21.15.143:6789/0 conn(0x7fc42c15d080 legacy=0x7fc42c0afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:03.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc423fff640 1 -- 172.21.15.143:0/1599974077 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c161010 con 0x7fc42c0b0210 2024-05-08T10:24:03.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.500+0000 7fc4237fe640 1 -- 172.21.15.143:0/1599974077 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141879112 0 0) 0x7fc42c0ae270 con 0x7fc42c15d080 2024-05-08T10:24:03.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.501+0000 7fc423fff640 1 --2- 172.21.15.143:0/1599974077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 0x7fc42c161810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009870 tx=0x7fc41c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90a6ef273cdca0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:03.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.501+0000 7fc4237fe640 1 -- 172.21.15.143:0/1599974077 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c037070 con 0x7fc42c0b0210 2024-05-08T10:24:03.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.501+0000 7fc4237fe640 1 -- 172.21.15.143:0/1599974077 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc41c032440 con 0x7fc42c0b0210 2024-05-08T10:24:03.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.501+0000 7fc4237fe640 1 -- 172.21.15.143:0/1599974077 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c032810 con 0x7fc42c0b0210 2024-05-08T10:24:03.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.502+0000 7fc432e45640 1 -- 172.21.15.143:0/1599974077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 msgr2=0x7fc42c161810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:03.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.502+0000 7fc432e45640 1 --2- 172.21.15.143:0/1599974077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 0x7fc42c161810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009870 tx=0x7fc41c02a270 comp rx=0 tx=0).stop 2024-05-08T10:24:03.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.502+0000 7fc432e45640 1 -- 172.21.15.143:0/1599974077 shutdown_connections 2024-05-08T10:24:03.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.502+0000 7fc432e45640 1 --2- 172.21.15.143:0/1599974077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 0x7fc42c072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.502+0000 7fc432e45640 1 --2- 172.21.15.143:0/1599974077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 0x7fc42c161810 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.502+0000 7fc432e45640 1 -- 172.21.15.143:0/1599974077 >> 172.21.15.143:0/1599974077 conn(0x7fc42c0b2bb0 msgr2=0x7fc42c0b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:03.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.502+0000 7fc432e45640 1 -- 172.21.15.143:0/1599974077 shutdown_connections 2024-05-08T10:24:03.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.502+0000 7fc432e45640 1 -- 172.21.15.143:0/1599974077 wait complete. 2024-05-08T10:24:03.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.503+0000 7fc432e45640 1 Processor -- start 2024-05-08T10:24:03.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.503+0000 7fc432e45640 1 -- start start 2024-05-08T10:24:03.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc432e45640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 0x7fc42c0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:03.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc432e45640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 0x7fc42c0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:03.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc432e45640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc42c15d080 0x7fc42c1f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:03.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc432e45640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c15d5e0 con 0x7fc42c0b0210 2024-05-08T10:24:03.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc432e45640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c15d460 con 0x7fc42c15d080 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc432e45640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc42c0ae550 con 0x7fc42c0701d0 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc423fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 0x7fc42c0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc423fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 0x7fc42c0b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40394/0 (socket says 172.21.15.143:40394) 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc423fff640 1 -- 172.21.15.143:0/1334029888 learned_addr learned my addr 172.21.15.143:0/1334029888 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc430be1640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 0x7fc42c0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc4313e2640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc42c15d080 0x7fc42c1f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc423fff640 1 -- 172.21.15.143:0/1334029888 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 msgr2=0x7fc42c0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc423fff640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 0x7fc42c0cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc423fff640 1 -- 172.21.15.143:0/1334029888 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc42c15d080 msgr2=0x7fc42c1f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc423fff640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc42c15d080 0x7fc42c1f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc423fff640 1 -- 172.21.15.143:0/1334029888 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c1f5db0 con 0x7fc42c0b0210 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc423fff640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 0x7fc42c0b3fb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc4217fa640 1 -- 172.21.15.143:0/1334029888 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c037040 con 0x7fc42c0b0210 2024-05-08T10:24:03.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc4217fa640 1 -- 172.21.15.143:0/1334029888 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc41c042070 con 0x7fc42c0b0210 2024-05-08T10:24:03.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42c1f6090 con 0x7fc42c0b0210 2024-05-08T10:24:03.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc4217fa640 1 -- 172.21.15.143:0/1334029888 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c030bd0 con 0x7fc42c0b0210 2024-05-08T10:24:03.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.504+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42c14f270 con 0x7fc42c0b0210 2024-05-08T10:24:03.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.505+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc42c14eda0 con 0x7fc42c0b0210 2024-05-08T10:24:03.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.506+0000 7fc4217fa640 1 -- 172.21.15.143:0/1334029888 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc41c047460 con 0x7fc42c0b0210 2024-05-08T10:24:03.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.506+0000 7fc4217fa640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4180762d0 0x7fc418078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:03.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.506+0000 7fc4217fa640 1 -- 172.21.15.143:0/1334029888 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc41c0b81e0 con 0x7fc42c0b0210 2024-05-08T10:24:03.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.506+0000 7fc430be1640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4180762d0 0x7fc418078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:03.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.507+0000 7fc430be1640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4180762d0 0x7fc418078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4280012e0 tx=0x7fc428009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:03.495 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.511+0000 7fc4217fa640 1 -- 172.21.15.143:0/1334029888 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc41c081b40 con 0x7fc42c0b0210 2024-05-08T10:24:03.718 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.730+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc42c0d0020 con 0x7fc42c0b0210 2024-05-08T10:24:03.718 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.730+0000 7fc4217fa640 1 -- 172.21.15.143:0/1334029888 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fc41c081440 con 0x7fc42c0b0210 2024-05-08T10:24:03.718 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:24:03.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4180762d0 msgr2=0x7fc418078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:03.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4180762d0 0x7fc418078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4280012e0 tx=0x7fc428009040 comp rx=0 tx=0).stop 2024-05-08T10:24:03.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 msgr2=0x7fc42c0b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:03.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 0x7fc42c0b3fb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 shutdown_connections 2024-05-08T10:24:03.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc42c15d080 0x7fc42c1f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4180762d0 0x7fc418078790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc42c0b0210 0x7fc42c0b3fb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 --2- 172.21.15.143:0/1334029888 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc42c0701d0 0x7fc42c0cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:03.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.732+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 >> 172.21.15.143:0/1334029888 conn(0x7fc42c0b2bb0 msgr2=0x7fc42c14e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:03.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.733+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 shutdown_connections 2024-05-08T10:24:03.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03.733+0000 7fc432e45640 1 -- 172.21.15.143:0/1334029888 wait complete. 2024-05-08T10:24:03.729 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T10:24:03.729 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:24:03.729 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2024-05-08T10:24:03.729 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T10:24:03.729 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:03.729 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T10:24:03.729 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T10:24:03.729 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:24:03.729 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:24:03.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:03.729 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2024-05-08T10:24:03.745 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:24:03.745 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:03.746 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:24:03.747 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:03.747 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T10:24:03.747 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42719sec preferred_lft 42719sec 2024-05-08T10:24:03.747 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2024-05-08T10:24:03.747 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:03.747 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T10:24:03.747 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:03.747 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:03.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add name ceph-brx type bridge 2024-05-08T10:24:03.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr flush dev ceph-brx 2024-05-08T10:24:03.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set ceph-brx up 2024-05-08T10:24:03.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T10:24:03.748 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:03.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:03.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:03.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:03.945 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:24:03.971 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-05-08T10:24:03.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:03.973 DEBUG:teuthology.orchestra.run.smithi143:> route 2024-05-08T10:24:04.036 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2024-05-08T10:24:04.036 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:24:04.036 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T10:24:04.036 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T10:24:04.037 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:24:04.037 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:04.037 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:04.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T10:24:04.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T10:24:04.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T10:24:04.037 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:04.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:04.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:04.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:04.308 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-05-08T10:24:04.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:04.324 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2024-05-08T10:24:04.380 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:04.380 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:04.380 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T10:24:04.380 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T10:24:04.380 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:04.470 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:04.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:04.500 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T10:24:04.500 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:04.500 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:04.500 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T10:24:04.500 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T10:24:04.500 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T10:24:04.500 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T10:24:04.500 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T10:24:04.500 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:04.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:04.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:04.628 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:04.629 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:04.629 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2024-05-08T10:24:04.629 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T10:24:04.629 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:04.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:04.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:04.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:04.705 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:04.720 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:24:04.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:04.721 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:04.776 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-08T10:24:04.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:04.776 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:04.866 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:04.867 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:04.970 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:04.971 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:04.971 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.163:3300,172.21.15.163:3301" 2024-05-08T10:24:04.971 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 0@aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64.cephfs=/ 2024-05-08T10:24:04.971 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.143:3300/172.21.15.163:3300/172.21.15.163:3301" will pass to kernel 2024-05-08T10:24:04.971 INFO:teuthology.orchestra.run.smithi143.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-08T10:24:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:24:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:24:04.971 INFO:teuthology.orchestra.run.smithi143.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:24:04.972 INFO:teuthology.orchestra.run.smithi143.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:24:04.973 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:24:04.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:04.973 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:04.998 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:05.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:05.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:05.101 INFO:teuthology.orchestra.run.smithi143.stdout:client4611 2024-05-08T10:24:05.101 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:05.101 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:05.118 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:05.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:05.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:05.220 INFO:teuthology.orchestra.run.smithi143.stdout:client4611 2024-05-08T10:24:05.221 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:05.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:05.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:05.281 INFO:teuthology.orchestra.run.smithi143.stdout:client4611 2024-05-08T10:24:05.282 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64.client4611/status') 2024-05-08T10:24:05.331 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:05.343 INFO:teuthology.orchestra.run.smithi143.stdout:instance: client.4611 (3)192.168.0.1:0/3990316888 2024-05-08T10:24:05.343 INFO:teuthology.orchestra.run.smithi143.stdout:blocklisted: false 2024-05-08T10:24:05.344 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records in 2024-05-08T10:24:05.344 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records out 2024-05-08T10:24:05.344 INFO:teuthology.orchestra.run.smithi143.stderr:69 bytes copied, 2.2518e-05 s, 3.1 MB/s 2024-05-08T10:24:05.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:05.351 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-05-08T10:24:05.353 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T10:24:05.353 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-08T10:24:05.353 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:24:05.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.469+0000 7efebd893640 1 Processor -- start 2024-05-08T10:24:05.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.469+0000 7efebd893640 1 -- start start 2024-05-08T10:24:05.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efebd893640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efeb815f2e0 0x7efeb8070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:05.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efebd893640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efeb806ebe0 0x7efeb815f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efebd893640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb815fc00 con 0x7efeb8072fe0 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efebd893640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7efeb80b6200 con 0x7efeb806ebe0 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efebd893640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7efeb806f0e0 con 0x7efeb815f2e0 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efeb67fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efeb806ebe0 0x7efeb815f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efeb67fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efeb806ebe0 0x7efeb815f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40404/0 (socket says 172.21.15.143:40404) 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efeb67fc640 1 -- 172.21.15.143:0/1161783062 learned_addr learned my addr 172.21.15.143:0/1161783062 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efeb6ffd640 1 --2- 172.21.15.143:0/1161783062 >> v2:172.21.15.163:3300/0 conn(0x7efeb815f2e0 0x7efeb8070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efeb67fc640 1 -- 172.21.15.143:0/1161783062 >> v2:172.21.15.163:3300/0 conn(0x7efeb815f2e0 msgr2=0x7efeb8070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efeb67fc640 1 --2- 172.21.15.143:0/1161783062 >> v2:172.21.15.163:3300/0 conn(0x7efeb815f2e0 0x7efeb8070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efeb67fc640 1 -- 172.21.15.143:0/1161783062 >> v1:172.21.15.163:6789/0 conn(0x7efeb8072fe0 legacy=0x7efeb80b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.470+0000 7efeb67fc640 1 -- 172.21.15.143:0/1161783062 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb806f3c0 con 0x7efeb806ebe0 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.471+0000 7efeb67fc640 1 --2- 172.21.15.143:0/1161783062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb806ebe0 0x7efeb815f6c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efeb8070830 tx=0x7efeac02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1def4e031c18b7df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:05.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.471+0000 7efeb5ffb640 1 -- 172.21.15.143:0/1161783062 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac036020 con 0x7efeb806ebe0 2024-05-08T10:24:05.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.471+0000 7efeb5ffb640 1 -- 172.21.15.143:0/1161783062 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeac032640 con 0x7efeb806ebe0 2024-05-08T10:24:05.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.471+0000 7efeb5ffb640 1 -- 172.21.15.143:0/1161783062 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac032a10 con 0x7efeb806ebe0 2024-05-08T10:24:05.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.472+0000 7efebd893640 1 -- 172.21.15.143:0/1161783062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb806ebe0 msgr2=0x7efeb815f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:05.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.472+0000 7efebd893640 1 --2- 172.21.15.143:0/1161783062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb806ebe0 0x7efeb815f6c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efeb8070830 tx=0x7efeac02c940 comp rx=0 tx=0).stop 2024-05-08T10:24:05.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.472+0000 7efebd893640 1 -- 172.21.15.143:0/1161783062 shutdown_connections 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.472+0000 7efebd893640 1 --2- 172.21.15.143:0/1161783062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb806ebe0 0x7efeb815f6c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.472+0000 7efebd893640 1 --2- 172.21.15.143:0/1161783062 >> v2:172.21.15.163:3300/0 conn(0x7efeb815f2e0 0x7efeb8070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.472+0000 7efebd893640 1 -- 172.21.15.143:0/1161783062 >> 172.21.15.143:0/1161783062 conn(0x7efeb80b2bb0 msgr2=0x7efeb80b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.472+0000 7efebd893640 1 -- 172.21.15.143:0/1161783062 shutdown_connections 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.472+0000 7efebd893640 1 -- 172.21.15.143:0/1161783062 wait complete. 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.473+0000 7efebd893640 1 Processor -- start 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.473+0000 7efebd893640 1 -- start start 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efebd893640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efeb806ebe0 0x7efeb81f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efebd893640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb8072fe0 0x7efeb81f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efebd893640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb815f2e0 0x7efeb80b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efebd893640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8073410 con 0x7efeb8072fe0 2024-05-08T10:24:05.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efebd893640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efeb806f980 con 0x7efeb815f2e0 2024-05-08T10:24:05.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efebd893640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7efeb8073590 con 0x7efeb806ebe0 2024-05-08T10:24:05.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb67fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb8072fe0 0x7efeb81f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:05.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb67fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb8072fe0 0x7efeb81f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40414/0 (socket says 172.21.15.143:40414) 2024-05-08T10:24:05.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb67fc640 1 -- 172.21.15.143:0/177799549 learned_addr learned my addr 172.21.15.143:0/177799549 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:05.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb77fe640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb815f2e0 0x7efeb80b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:05.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb6ffd640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efeb806ebe0 0x7efeb81f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:05.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb67fc640 1 -- 172.21.15.143:0/177799549 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efeb806ebe0 msgr2=0x7efeb81f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:05.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb67fc640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efeb806ebe0 0x7efeb81f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb67fc640 1 -- 172.21.15.143:0/177799549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb815f2e0 msgr2=0x7efeb80b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb67fc640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb815f2e0 0x7efeb80b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb67fc640 1 -- 172.21.15.143:0/177799549 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb81f1500 con 0x7efeb8072fe0 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.474+0000 7efeb6ffd640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efeb806ebe0 0x7efeb81f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.475+0000 7efeb67fc640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb8072fe0 0x7efeb81f4d20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efeac02c980 tx=0x7efeac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.475+0000 7efe9ffff640 1 -- 172.21.15.143:0/177799549 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac036040 con 0x7efeb8072fe0 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.475+0000 7efe9ffff640 1 -- 172.21.15.143:0/177799549 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeac03cc10 con 0x7efeb8072fe0 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.475+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb81f17a0 con 0x7efeb8072fe0 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.475+0000 7efe9ffff640 1 -- 172.21.15.143:0/177799549 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac0463f0 con 0x7efeb8072fe0 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.475+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81f1d60 con 0x7efeb8072fe0 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.476+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb806a4b0 con 0x7efeb8072fe0 2024-05-08T10:24:05.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.476+0000 7efe9ffff640 1 -- 172.21.15.143:0/177799549 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efeac04d060 con 0x7efeb8072fe0 2024-05-08T10:24:05.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.477+0000 7efe9ffff640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efea40762d0 0x7efea4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:05.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.477+0000 7efeb6ffd640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efea40762d0 0x7efea4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:05.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.477+0000 7efe9ffff640 1 -- 172.21.15.143:0/177799549 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efeac0ba530 con 0x7efeb8072fe0 2024-05-08T10:24:05.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.478+0000 7efeb6ffd640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efea40762d0 0x7efea4078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efeb815e150 tx=0x7efea8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:05.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.481+0000 7efe9ffff640 1 -- 172.21.15.143:0/177799549 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efeac041070 con 0x7efeb8072fe0 2024-05-08T10:24:05.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.699+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efeb80b42c0 con 0x7efeb8072fe0 2024-05-08T10:24:05.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.699+0000 7efe9ffff640 1 -- 172.21.15.143:0/177799549 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7efeac083e90 con 0x7efeb8072fe0 2024-05-08T10:24:05.684 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:24:05.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efea40762d0 msgr2=0x7efea4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:05.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efea40762d0 0x7efea4078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efeb815e150 tx=0x7efea8008040 comp rx=0 tx=0).stop 2024-05-08T10:24:05.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb8072fe0 msgr2=0x7efeb81f4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:05.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb8072fe0 0x7efeb81f4d20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efeac02c980 tx=0x7efeac0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 shutdown_connections 2024-05-08T10:24:05.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb815f2e0 0x7efeb80b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efea40762d0 0x7efea4078790 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efeb8072fe0 0x7efeb81f4d20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 --2- 172.21.15.143:0/177799549 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efeb806ebe0 0x7efeb81f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:05.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 >> 172.21.15.143:0/177799549 conn(0x7efeb80b2bb0 msgr2=0x7efeb80af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:05.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 shutdown_connections 2024-05-08T10:24:05.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05.701+0000 7efebd893640 1 -- 172.21.15.143:0/177799549 wait complete. 2024-05-08T10:24:05.697 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T10:24:05.697 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:24:05.697 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2024-05-08T10:24:05.697 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-08T10:24:05.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-08T10:24:05.698 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T10:24:05.698 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T10:24:05.698 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:24:05.698 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-08T10:24:05.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:05.698 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2024-05-08T10:24:05.714 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:24:05.714 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:24:05.714 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:24:05.714 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:05.714 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-05-08T10:24:05.714 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42717sec preferred_lft 42717sec 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2024-05-08T10:24:05.715 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether ee:3b:86:30:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::8408:c6ff:fe90:3d18/64 scope link 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether ee:3b:86:30:cb:a3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec3b:86ff:fe30:cba3/64 scope link tentative 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:05.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:05.717 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:24:05.778 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-05-08T10:24:05.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:05.780 DEBUG:teuthology.orchestra.run.smithi143:> route 2024-05-08T10:24:05.836 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2024-05-08T10:24:05.836 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:24:05.836 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T10:24:05.836 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T10:24:05.836 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:24:05.837 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:05.837 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:05.837 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T10:24:05.837 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T10:24:05.837 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T10:24:05.837 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:05.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:05.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:05.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:05.964 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-05-08T10:24:05.979 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T10:24:05.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:05.980 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2024-05-08T10:24:06.035 INFO:teuthology.orchestra.run.smithi143.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-08T10:24:06.036 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:06.036 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:06.036 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T10:24:06.036 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-08T10:24:06.036 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:06.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:06.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:06.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:06.154 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-08T10:24:06.179 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:24:06.179 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether b6:fd:34:0e:cc:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::b4fd:34ff:fe0e:ccf6/64 scope link tentative 2024-05-08T10:24:06.180 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:06.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:06.181 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-08T10:24:06.247 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:24:06.247 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether b6:fd:34:0e:cc:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::b4fd:34ff:fe0e:ccf6/64 scope link tentative 2024-05-08T10:24:06.248 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:06.250 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-08T10:24:06.250 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:06.250 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:06.250 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-08T10:24:06.250 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-08T10:24:06.250 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-08T10:24:06.251 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-08T10:24:06.251 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-08T10:24:06.251 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:06.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:06.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:06.402 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:06.402 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:06.403 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.1 up 2024-05-08T10:24:06.403 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.1 master ceph-brx 2024-05-08T10:24:06.403 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:06.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:06.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:06.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:06.480 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-08T10:24:06.507 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-08T10:24:06.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:06.508 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-08T10:24:06.564 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-05-08T10:24:06.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:06.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:06.647 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:06.648 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:06.655 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:06.656 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:06.656 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.163:3300,172.21.15.163:3301" 2024-05-08T10:24:06.656 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 2@aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64.cephfs=/ 2024-05-08T10:24:06.656 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.143:3300/172.21.15.163:3300/172.21.15.163:3301" will pass to kernel 2024-05-08T10:24:06.656 INFO:teuthology.orchestra.run.smithi143.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-08T10:24:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:24:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:24:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:24:06.656 INFO:teuthology.orchestra.run.smithi143.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:24:06.658 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:24:06.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:06.658 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-08T10:24:06.724 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:06.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:06.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:06.820 INFO:teuthology.orchestra.run.smithi143.stdout:client4561 2024-05-08T10:24:06.820 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:06.820 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:06.837 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:06.926 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:06.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:06.934 INFO:teuthology.orchestra.run.smithi143.stdout:client4561 2024-05-08T10:24:06.934 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:06.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:06.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:06.990 INFO:teuthology.orchestra.run.smithi143.stdout:client4561 2024-05-08T10:24:06.991 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64.client4561/status') 2024-05-08T10:24:07.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:07.051 INFO:teuthology.orchestra.run.smithi143.stdout:instance: client.4561 (3)172.21.15.143:0/758725718 2024-05-08T10:24:07.052 INFO:teuthology.orchestra.run.smithi143.stdout:blocklisted: false 2024-05-08T10:24:07.052 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records in 2024-05-08T10:24:07.052 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records out 2024-05-08T10:24:07.052 INFO:teuthology.orchestra.run.smithi143.stderr:70 bytes copied, 2.2368e-05 s, 3.1 MB/s 2024-05-08T10:24:07.053 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:07.059 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-05-08T10:24:07.059 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T10:24:07.059 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T10:24:07.059 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:24:07.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.173+0000 7ff2288bd640 1 Processor -- start 2024-05-08T10:24:07.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.173+0000 7ff2288bd640 1 -- start start 2024-05-08T10:24:07.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff2288bd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff224159a30 0x7ff2240b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:07.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff2288bd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff224159e10 0x7ff22406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:07.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff2288bd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22415ffc0 con 0x7ff22406d870 2024-05-08T10:24:07.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff2288bd640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff2241602a0 con 0x7ff224159a30 2024-05-08T10:24:07.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff2288bd640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ff224160580 con 0x7ff224159e10 2024-05-08T10:24:07.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff22259c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff224159a30 0x7ff2240b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:07.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff222d9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff22406d870 0x7ff2241631d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:50334/0 (socket says 172.21.15.143:50334) 2024-05-08T10:24:07.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff222d9d640 1 -- 172.21.15.143:0/927389885 learned_addr learned my addr 172.21.15.143:0/927389885 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:07.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff21bfff640 1 --2- 172.21.15.143:0/927389885 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff224159e10 0x7ff22406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:07.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff22259c640 1 -- 172.21.15.143:0/927389885 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff224159e10 msgr2=0x7ff22406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:07.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff22259c640 1 --2- 172.21.15.143:0/927389885 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff224159e10 0x7ff22406d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff22259c640 1 -- 172.21.15.143:0/927389885 >> v1:172.21.15.143:6789/0 conn(0x7ff22406d870 legacy=0x7ff2241631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:07.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff22259c640 1 -- 172.21.15.143:0/927389885 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff224160860 con 0x7ff224159a30 2024-05-08T10:24:07.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.174+0000 7ff221d9b640 1 -- 172.21.15.143:0/927389885 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882897929 0 0) 0x7ff22415ffc0 con 0x7ff22406d870 2024-05-08T10:24:07.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.175+0000 7ff22259c640 1 --2- 172.21.15.143:0/927389885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 0x7ff2240b4960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2140097a0 tx=0x7ff21402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e1a296676fd46e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:07.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.175+0000 7ff221d9b640 1 -- 172.21.15.143:0/927389885 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214037070 con 0x7ff224159a30 2024-05-08T10:24:07.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.175+0000 7ff221d9b640 1 -- 172.21.15.143:0/927389885 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21402adb0 con 0x7ff224159a30 2024-05-08T10:24:07.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.175+0000 7ff221d9b640 1 -- 172.21.15.143:0/927389885 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214032660 con 0x7ff224159a30 2024-05-08T10:24:07.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.176+0000 7ff2288bd640 1 -- 172.21.15.143:0/927389885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 msgr2=0x7ff2240b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:07.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.176+0000 7ff2288bd640 1 --2- 172.21.15.143:0/927389885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 0x7ff2240b4960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2140097a0 tx=0x7ff21402a060 comp rx=0 tx=0).stop 2024-05-08T10:24:07.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.176+0000 7ff2288bd640 1 -- 172.21.15.143:0/927389885 shutdown_connections 2024-05-08T10:24:07.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.176+0000 7ff2288bd640 1 --2- 172.21.15.143:0/927389885 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff224159e10 0x7ff22406d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.176+0000 7ff2288bd640 1 --2- 172.21.15.143:0/927389885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 0x7ff2240b4960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.176+0000 7ff2288bd640 1 -- 172.21.15.143:0/927389885 >> 172.21.15.143:0/927389885 conn(0x7ff224072bd0 msgr2=0x7ff224072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:07.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.176+0000 7ff2288bd640 1 -- 172.21.15.143:0/927389885 shutdown_connections 2024-05-08T10:24:07.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.176+0000 7ff2288bd640 1 -- 172.21.15.143:0/927389885 wait complete. 2024-05-08T10:24:07.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.177+0000 7ff2288bd640 1 Processor -- start 2024-05-08T10:24:07.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.177+0000 7ff2288bd640 1 -- start start 2024-05-08T10:24:07.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff2288bd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff22406d870 0x7ff224155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:07.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff2288bd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 0x7ff2240b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:07.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff2288bd640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224159e10 0x7ff2241f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:07.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff2288bd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff2240b5020 con 0x7ff224159a30 2024-05-08T10:24:07.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff2288bd640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff2240b4ea0 con 0x7ff224159e10 2024-05-08T10:24:07.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff2288bd640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ff2240afc00 con 0x7ff22406d870 2024-05-08T10:24:07.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff21bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 0x7ff2240b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff21bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 0x7ff2240b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40434/0 (socket says 172.21.15.143:40434) 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff21bfff640 1 -- 172.21.15.143:0/3267954685 learned_addr learned my addr 172.21.15.143:0/3267954685 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff22259c640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff22406d870 0x7ff224155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff222d9d640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224159e10 0x7ff2241f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff21bfff640 1 -- 172.21.15.143:0/3267954685 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff22406d870 msgr2=0x7ff224155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff21bfff640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff22406d870 0x7ff224155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff21bfff640 1 -- 172.21.15.143:0/3267954685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224159e10 msgr2=0x7ff2241f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff21bfff640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224159e10 0x7ff2241f7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff21bfff640 1 -- 172.21.15.143:0/3267954685 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff224160c00 con 0x7ff224159a30 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.178+0000 7ff21bfff640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 0x7ff2240b2890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00d800 tx=0x7ff20c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:07.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.179+0000 7ff21affd640 1 -- 172.21.15.143:0/3267954685 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00b6c0 con 0x7ff224159a30 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.179+0000 7ff21affd640 1 -- 172.21.15.143:0/3267954685 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20c019070 con 0x7ff224159a30 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.179+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff224161190 con 0x7ff224159a30 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.179+0000 7ff21affd640 1 -- 172.21.15.143:0/3267954685 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00ba80 con 0x7ff224159a30 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.179+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff224161750 con 0x7ff224159a30 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.180+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22406a4b0 con 0x7ff224159a30 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.180+0000 7ff21affd640 1 -- 172.21.15.143:0/3267954685 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff20c00bc20 con 0x7ff224159a30 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.181+0000 7ff21affd640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff2040762d0 0x7ff204078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.181+0000 7ff22259c640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff2040762d0 0x7ff204078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.181+0000 7ff21affd640 1 -- 172.21.15.143:0/3267954685 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff20c097ad0 con 0x7ff224159a30 2024-05-08T10:24:07.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.181+0000 7ff22259c640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff2040762d0 0x7ff204078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff214034000 tx=0x7ff21402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:07.175 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.185+0000 7ff21affd640 1 -- 172.21.15.143:0/3267954685 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff20c061430 con 0x7ff224159a30 2024-05-08T10:24:07.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.403+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff22415f830 con 0x7ff224159a30 2024-05-08T10:24:07.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.404+0000 7ff21affd640 1 -- 172.21.15.143:0/3267954685 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7ff20c060d30 con 0x7ff224159a30 2024-05-08T10:24:07.389 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:24:07.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff2040762d0 msgr2=0x7ff204078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:07.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff2040762d0 0x7ff204078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff214034000 tx=0x7ff21402e000 comp rx=0 tx=0).stop 2024-05-08T10:24:07.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 msgr2=0x7ff2240b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:07.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 0x7ff2240b2890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00d800 tx=0x7ff20c00dcc0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 shutdown_connections 2024-05-08T10:24:07.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224159e10 0x7ff2241f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff2040762d0 0x7ff204078790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff224159a30 0x7ff2240b2890 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 --2- 172.21.15.143:0/3267954685 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff22406d870 0x7ff224155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:07.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 >> 172.21.15.143:0/3267954685 conn(0x7ff224072bd0 msgr2=0x7ff224157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:07.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 shutdown_connections 2024-05-08T10:24:07.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:07.406+0000 7ff2288bd640 1 -- 172.21.15.143:0/3267954685 wait complete. 2024-05-08T10:24:07.402 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T10:24:07.402 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:24:07.402 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2024-05-08T10:24:07.402 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-08T10:24:07.402 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T10:24:07.402 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T10:24:07.402 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T10:24:07.403 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:24:07.403 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T10:24:07.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:07.404 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2024-05-08T10:24:07.424 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:24:07.424 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:24:07.424 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:24:07.424 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:07.424 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f0 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f1 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-05-08T10:24:07.425 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::ec4:7aff:fe88:7d5b/64 scope link 2024-05-08T10:24:07.426 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:07.426 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T10:24:07.426 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:07.426 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-05-08T10:24:07.426 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add name ceph-brx type bridge 2024-05-08T10:24:07.426 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr flush dev ceph-brx 2024-05-08T10:24:07.426 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set ceph-brx up 2024-05-08T10:24:07.426 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T10:24:07.426 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-05-08T10:24:07.521 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:07.939 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:07.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:07.946 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:24:07.973 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-05-08T10:24:07.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:07.975 DEBUG:teuthology.orchestra.run.smithi163:> route 2024-05-08T10:24:08.040 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2024-05-08T10:24:08.040 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:24:08.040 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T10:24:08.040 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T10:24:08.040 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:24:08.041 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:08.041 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-05-08T10:24:08.041 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T10:24:08.041 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T10:24:08.041 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T10:24:08.041 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-05-08T10:24:08.130 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:08.336 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:08.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:08.343 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-05-08T10:24:08.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:08.358 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2024-05-08T10:24:08.413 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:08.414 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-05-08T10:24:08.414 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T10:24:08.414 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-08T10:24:08.414 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-05-08T10:24:08.503 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:08.528 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:08.535 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-08T10:24:08.535 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:08.535 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-05-08T10:24:08.535 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-08T10:24:08.535 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T10:24:08.535 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-08T10:24:08.535 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-08T10:24:08.535 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-08T10:24:08.535 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-05-08T10:24:08.585 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:08.677 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:08.684 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:08.684 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-05-08T10:24:08.684 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.0 up 2024-05-08T10:24:08.684 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T10:24:08.684 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-05-08T10:24:08.734 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:08.760 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:08.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:08.768 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-08T10:24:08.797 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-08T10:24:08.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:08.798 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-08T10:24:08.862 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-08T10:24:08.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:08.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:08.962 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:08.962 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:09.088 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:09.088 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:09.088 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.163:3300,172.21.15.163:3301" 2024-05-08T10:24:09.088 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: trying mount with new device syntax: 1@aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64.cephfs=/ 2024-05-08T10:24:09.088 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.143:3300/172.21.15.163:3300/172.21.15.163:3301" will pass to kernel 2024-05-08T10:24:09.089 INFO:teuthology.orchestra.run.smithi163.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-08T10:24:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:24:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:24:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:24:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:24:09.091 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:24:09.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:09.091 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-08T10:24:09.119 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:09.208 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:09.210 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:09.216 INFO:teuthology.orchestra.run.smithi163.stdout:client4564 2024-05-08T10:24:09.216 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:09.216 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:09.233 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:09.322 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:09.324 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:09.330 INFO:teuthology.orchestra.run.smithi163.stdout:client4564 2024-05-08T10:24:09.330 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:09.379 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:09.381 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:09.386 INFO:teuthology.orchestra.run.smithi163.stdout:client4564 2024-05-08T10:24:09.386 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64.client4564/status') 2024-05-08T10:24:09.436 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:09.447 INFO:teuthology.orchestra.run.smithi163.stdout:instance: client.4564 (3)192.168.0.1:0/650185658 2024-05-08T10:24:09.447 INFO:teuthology.orchestra.run.smithi163.stdout:blocklisted: false 2024-05-08T10:24:09.447 INFO:teuthology.orchestra.run.smithi163.stderr:0+1 records in 2024-05-08T10:24:09.447 INFO:teuthology.orchestra.run.smithi163.stderr:0+1 records out 2024-05-08T10:24:09.447 INFO:teuthology.orchestra.run.smithi163.stderr:68 bytes copied, 2.4151e-05 s, 2.8 MB/s 2024-05-08T10:24:09.447 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:09.454 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-05-08T10:24:09.454 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T10:24:09.454 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-08T10:24:09.454 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:24:09.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.581+0000 7f9ebc2e8640 1 Processor -- start 2024-05-08T10:24:09.566 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.581+0000 7f9ebc2e8640 1 -- start start 2024-05-08T10:24:09.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.582+0000 7f9ebc2e8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9eb415f2e0 0x7f9eb4070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:09.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.582+0000 7f9ebc2e8640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9eb406ebe0 0x7f9eb415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:09.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.582+0000 7f9ebc2e8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9eb4072fe0 0x7f9eb40b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:09.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.582+0000 7f9ebc2e8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb40b6200 con 0x7f9eb4072fe0 2024-05-08T10:24:09.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.582+0000 7f9ebc2e8640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb415fc00 con 0x7f9eb406ebe0 2024-05-08T10:24:09.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.582+0000 7f9ebc2e8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb406f0e0 con 0x7f9eb415f2e0 2024-05-08T10:24:09.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.583+0000 7f9eba885640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9eb4072fe0 0x7f9eb40b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:09.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.583+0000 7f9eba885640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9eb4072fe0 0x7f9eb40b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40450/0 (socket says 172.21.15.143:40450) 2024-05-08T10:24:09.568 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.583+0000 7f9eba885640 1 -- 172.21.15.143:0/2776630880 learned_addr learned my addr 172.21.15.143:0/2776630880 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:09.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.583+0000 7f9eba885640 1 -- 172.21.15.143:0/2776630880 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9eb415f2e0 msgr2=0x7f9eb4070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:09.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.583+0000 7f9eba885640 1 --2- 172.21.15.143:0/2776630880 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9eb415f2e0 0x7f9eb4070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.583+0000 7f9eba885640 1 -- 172.21.15.143:0/2776630880 >> v2:172.21.15.163:3300/0 conn(0x7f9eb406ebe0 msgr2=0x7f9eb415f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:09.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.583+0000 7f9eba885640 1 --2- 172.21.15.143:0/2776630880 >> v2:172.21.15.163:3300/0 conn(0x7f9eb406ebe0 0x7f9eb415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.583+0000 7f9eba885640 1 -- 172.21.15.143:0/2776630880 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb406f3c0 con 0x7f9eb4072fe0 2024-05-08T10:24:09.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9eba885640 1 --2- 172.21.15.143:0/2776630880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb4072fe0 0x7f9eb40b44e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40d1ee0 tx=0x7f9eac02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af44c2dfd99bb5b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:09.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9eb9082640 1 -- 172.21.15.143:0/2776630880 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00b2e0 con 0x7f9eb4072fe0 2024-05-08T10:24:09.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9eb9082640 1 -- 172.21.15.143:0/2776630880 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eac009600 con 0x7f9eb4072fe0 2024-05-08T10:24:09.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9eb9082640 1 -- 172.21.15.143:0/2776630880 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00b480 con 0x7f9eb4072fe0 2024-05-08T10:24:09.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/2776630880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb4072fe0 msgr2=0x7f9eb40b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:09.570 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/2776630880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb4072fe0 0x7f9eb40b44e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40d1ee0 tx=0x7f9eac02c8a0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/2776630880 shutdown_connections 2024-05-08T10:24:09.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/2776630880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb4072fe0 0x7f9eb40b44e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/2776630880 >> v2:172.21.15.163:3300/0 conn(0x7f9eb406ebe0 0x7f9eb415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/2776630880 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9eb415f2e0 0x7f9eb4070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/2776630880 >> 172.21.15.143:0/2776630880 conn(0x7f9eb40b2bb0 msgr2=0x7f9eb40b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:09.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.584+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/2776630880 shutdown_connections 2024-05-08T10:24:09.571 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.585+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/2776630880 wait complete. 2024-05-08T10:24:09.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.586+0000 7f9ebc2e8640 1 Processor -- start 2024-05-08T10:24:09.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.586+0000 7f9ebc2e8640 1 -- start start 2024-05-08T10:24:09.573 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.586+0000 7f9ebc2e8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb406ebe0 0x7f9eb4150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.586+0000 7f9ebc2e8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9eb4072fe0 0x7f9eb4152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.586+0000 7f9ebc2e8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9eb415f2e0 0x7f9eb415a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.586+0000 7f9ebc2e8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4073470 con 0x7f9eb406ebe0 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.586+0000 7f9ebc2e8640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb406f980 con 0x7f9eb4072fe0 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.586+0000 7f9ebc2e8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb40735f0 con 0x7f9eb415f2e0 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.586+0000 7f9eba084640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb406ebe0 0x7f9eb4150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eba084640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb406ebe0 0x7f9eb4150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40456/0 (socket says 172.21.15.143:40456) 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eba084640 1 -- 172.21.15.143:0/355294113 learned_addr learned my addr 172.21.15.143:0/355294113 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eba885640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9eb415f2e0 0x7f9eb415a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eb9883640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9eb4072fe0 0x7f9eb4152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eba084640 1 -- 172.21.15.143:0/355294113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9eb415f2e0 msgr2=0x7f9eb415a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eba084640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9eb415f2e0 0x7f9eb415a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.574 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eba084640 1 -- 172.21.15.143:0/355294113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9eb4072fe0 msgr2=0x7f9eb4152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eba084640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9eb4072fe0 0x7f9eb4152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eba084640 1 -- 172.21.15.143:0/355294113 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb41511d0 con 0x7f9eb406ebe0 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eb9883640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9eb4072fe0 0x7f9eb4152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eba084640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb406ebe0 0x7f9eb4150840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000b4a0 tx=0x7f9eb000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eaaffd640 1 -- 172.21.15.143:0/355294113 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0014070 con 0x7f9eb406ebe0 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eaaffd640 1 -- 172.21.15.143:0/355294113 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb0010610 con 0x7f9eb406ebe0 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb41514b0 con 0x7f9eb406ebe0 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9eaaffd640 1 -- 172.21.15.143:0/355294113 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0010a00 con 0x7f9eb406ebe0 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.587+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb4151d50 con 0x7f9eb406ebe0 2024-05-08T10:24:09.575 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.588+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb4151680 con 0x7f9eb406ebe0 2024-05-08T10:24:09.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.589+0000 7f9eaaffd640 1 -- 172.21.15.143:0/355294113 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9eb0017070 con 0x7f9eb406ebe0 2024-05-08T10:24:09.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.589+0000 7f9eaaffd640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9e980762d0 0x7f9e98078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:09.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.590+0000 7f9eb9883640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9e980762d0 0x7f9e98078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:09.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.590+0000 7f9eaaffd640 1 -- 172.21.15.143:0/355294113 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9eb0096fc0 con 0x7f9eb406ebe0 2024-05-08T10:24:09.576 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.590+0000 7f9eb9883640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9e980762d0 0x7f9e98078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40aef80 tx=0x7f9ea4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:09.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.594+0000 7f9eaaffd640 1 -- 172.21.15.143:0/355294113 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9eb00602d0 con 0x7f9eb406ebe0 2024-05-08T10:24:09.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.813+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9eb4151f50 con 0x7f9eb406ebe0 2024-05-08T10:24:09.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.813+0000 7f9eaaffd640 1 -- 172.21.15.143:0/355294113 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f9eb4151f50 con 0x7f9eb406ebe0 2024-05-08T10:24:09.798 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:24:09.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9e980762d0 msgr2=0x7f9e98078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:09.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9e980762d0 0x7f9e98078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40aef80 tx=0x7f9ea4008040 comp rx=0 tx=0).stop 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb406ebe0 msgr2=0x7f9eb4150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb406ebe0 0x7f9eb4150840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000b4a0 tx=0x7f9eb000b960 comp rx=0 tx=0).stop 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 shutdown_connections 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9eb415f2e0 0x7f9eb415a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9eb4072fe0 0x7f9eb4152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9e980762d0 0x7f9e98078790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 --2- 172.21.15.143:0/355294113 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb406ebe0 0x7f9eb4150840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 >> 172.21.15.143:0/355294113 conn(0x7f9eb40b2bb0 msgr2=0x7f9eb4154cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 shutdown_connections 2024-05-08T10:24:09.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:09.815+0000 7f9ebc2e8640 1 -- 172.21.15.143:0/355294113 wait complete. 2024-05-08T10:24:09.811 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T10:24:09.811 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:24:09.811 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2024-05-08T10:24:09.812 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-08T10:24:09.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-08T10:24:09.812 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T10:24:09.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T10:24:09.812 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:24:09.812 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-08T10:24:09.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:09.812 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2024-05-08T10:24:09.828 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:24:09.828 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:24:09.829 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:24:09.829 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:09.829 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2024-05-08T10:24:09.829 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:09.829 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:09.829 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:09.829 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f0 2024-05-08T10:24:09.829 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:09.829 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f1 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 42729sec preferred_lft 42729sec 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::ec4:7aff:fe88:7d5b/64 scope link 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 16:e4:cd:fa:a3:55 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:09.830 INFO:teuthology.orchestra.run.smithi163.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T10:24:09.831 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:09.831 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::a82f:afff:fe4d:700b/64 scope link tentative 2024-05-08T10:24:09.831 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:09.831 INFO:teuthology.orchestra.run.smithi163.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:24:09.831 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 16:e4:cd:fa:a3:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T10:24:09.831 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::14e4:cdff:fefa:a355/64 scope link tentative 2024-05-08T10:24:09.831 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:09.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:09.831 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:24:09.893 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-05-08T10:24:09.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:09.895 DEBUG:teuthology.orchestra.run.smithi163:> route 2024-05-08T10:24:09.951 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2024-05-08T10:24:09.952 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:24:09.952 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T10:24:09.952 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T10:24:09.952 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:24:09.952 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:09.952 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-05-08T10:24:09.952 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T10:24:09.952 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T10:24:09.952 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T10:24:09.953 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-05-08T10:24:10.041 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:10.073 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:10.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:10.079 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-05-08T10:24:10.095 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T10:24:10.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:10.095 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2024-05-08T10:24:10.150 INFO:teuthology.orchestra.run.smithi163.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-08T10:24:10.151 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:10.151 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-05-08T10:24:10.151 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T10:24:10.151 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-08T10:24:10.151 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-05-08T10:24:10.239 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:10.262 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:10.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:10.268 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 32:b3:e5:6d:88:29 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:10.293 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::30b3:e5ff:fe6d:8829/64 scope link 2024-05-08T10:24:10.294 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:10.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:10.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-08T10:24:10.359 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:24:10.359 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:24:10.359 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:24:10.359 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:10.360 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2024-05-08T10:24:10.360 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:10.360 INFO:teuthology.orchestra.run.smithi163.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:24:10.360 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 32:b3:e5:6d:88:29 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T10:24:10.360 INFO:teuthology.orchestra.run.smithi163.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T10:24:10.360 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:10.360 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::30b3:e5ff:fe6d:8829/64 scope link 2024-05-08T10:24:10.360 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:10.361 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-08T10:24:10.361 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:10.361 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-05-08T10:24:10.361 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-08T10:24:10.362 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-08T10:24:10.362 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-08T10:24:10.362 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-08T10:24:10.362 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-08T10:24:10.362 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-05-08T10:24:10.449 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:10.508 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:10.515 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:10.515 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2024-05-08T10:24:10.515 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.1 up 2024-05-08T10:24:10.515 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.1 master ceph-brx 2024-05-08T10:24:10.515 DEBUG:teuthology.orchestra.run.smithi163:> ') 2024-05-08T10:24:10.564 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:10.587 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:10.593 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:10.593 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-08T10:24:10.608 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-08T10:24:10.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:10.609 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-08T10:24:10.665 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-05-08T10:24:10.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:10.665 DEBUG:teuthology.orchestra.run.smithi163:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:10.748 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:10.749 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:10.756 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:10.757 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:10.757 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.163:3300,172.21.15.163:3301" 2024-05-08T10:24:10.757 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: trying mount with new device syntax: 3@aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64.cephfs=/ 2024-05-08T10:24:10.757 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.143:3300/172.21.15.163:3300/172.21.15.163:3301" will pass to kernel 2024-05-08T10:24:10.757 INFO:teuthology.orchestra.run.smithi163.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-08T10:24:10.757 INFO:teuthology.orchestra.run.smithi163.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:24:10.757 INFO:teuthology.orchestra.run.smithi163.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:24:10.758 INFO:teuthology.orchestra.run.smithi163.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:24:10.758 INFO:teuthology.orchestra.run.smithi163.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:24:10.759 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:24:10.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:10.759 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-08T10:24:10.824 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:10.914 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:10.916 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:10.922 INFO:teuthology.orchestra.run.smithi163.stdout:client4635 2024-05-08T10:24:10.922 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:10.923 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:10.938 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:11.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:11.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:11.034 INFO:teuthology.orchestra.run.smithi163.stdout:client4635 2024-05-08T10:24:11.035 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:11.084 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:11.086 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:11.092 INFO:teuthology.orchestra.run.smithi163.stdout:client4635 2024-05-08T10:24:11.092 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64.client4635/status') 2024-05-08T10:24:11.141 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:11.151 INFO:teuthology.orchestra.run.smithi163.stdout:instance: client.4635 (3)172.21.15.163:0/238451627 2024-05-08T10:24:11.151 INFO:teuthology.orchestra.run.smithi163.stdout:blocklisted: false 2024-05-08T10:24:11.152 INFO:teuthology.orchestra.run.smithi163.stderr:0+1 records in 2024-05-08T10:24:11.152 INFO:teuthology.orchestra.run.smithi163.stderr:0+1 records out 2024-05-08T10:24:11.152 INFO:teuthology.orchestra.run.smithi163.stderr:70 bytes copied, 4.0262e-05 s, 1.7 MB/s 2024-05-08T10:24:11.152 INFO:teuthology.orchestra.run.smithi163.stderr:2024-05-08T10:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:11.159 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-08T10:24:11.269 INFO:tasks.cephfs_test_runner:Starting test: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-08T10:24:11.269 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:11.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.396+0000 7f0534b46640 1 Processor -- start 2024-05-08T10:24:11.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.396+0000 7f0534b46640 1 -- start start 2024-05-08T10:24:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f0534b46640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f05300aef80 0x7f0530073f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f0534b46640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f05300d2170 0x7f05300d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f0534b46640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05300b74f0 con 0x7f0530162900 2024-05-08T10:24:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f0534b46640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f0530162ce0 con 0x7f05300d2170 2024-05-08T10:24:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f0534b46640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f05300d2ac0 con 0x7f05300aef80 2024-05-08T10:24:11.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f052ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f05300d2170 0x7f05300d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f052ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f05300d2170 0x7f05300d2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40472/0 (socket says 172.21.15.143:40472) 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f052ed9d640 1 -- 172.21.15.143:0/423857447 learned_addr learned my addr 172.21.15.143:0/423857447 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f0525d9b640 1 --2- 172.21.15.143:0/423857447 >> v2:172.21.15.163:3300/0 conn(0x7f05300aef80 0x7f0530073f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f052ed9d640 1 -- 172.21.15.143:0/423857447 >> v2:172.21.15.163:3300/0 conn(0x7f05300aef80 msgr2=0x7f0530073f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f052ed9d640 1 --2- 172.21.15.143:0/423857447 >> v2:172.21.15.163:3300/0 conn(0x7f05300aef80 0x7f0530073f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f052ed9d640 1 -- 172.21.15.143:0/423857447 >> v1:172.21.15.163:6789/0 conn(0x7f0530162900 legacy=0x7f05300b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.397+0000 7f052ed9d640 1 -- 172.21.15.143:0/423857447 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05300b50b0 con 0x7f05300d2170 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.398+0000 7f052ed9d640 1 --2- 172.21.15.143:0/423857447 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300d2170 0x7f05300d2580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0530071560 tx=0x7f052802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5423591ce8d2f649 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.398+0000 7f052dd9b640 1 -- 172.21.15.143:0/423857447 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0528036070 con 0x7f05300d2170 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.398+0000 7f052dd9b640 1 -- 172.21.15.143:0/423857447 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0528031600 con 0x7f05300d2170 2024-05-08T10:24:11.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.398+0000 7f052dd9b640 1 -- 172.21.15.143:0/423857447 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05280319d0 con 0x7f05300d2170 2024-05-08T10:24:11.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.399+0000 7f0534b46640 1 -- 172.21.15.143:0/423857447 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300d2170 msgr2=0x7f05300d2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.399+0000 7f0534b46640 1 --2- 172.21.15.143:0/423857447 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300d2170 0x7f05300d2580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0530071560 tx=0x7f052802a6a0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.399+0000 7f0534b46640 1 -- 172.21.15.143:0/423857447 shutdown_connections 2024-05-08T10:24:11.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.399+0000 7f0534b46640 1 --2- 172.21.15.143:0/423857447 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300d2170 0x7f05300d2580 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.399+0000 7f0534b46640 1 --2- 172.21.15.143:0/423857447 >> v2:172.21.15.163:3300/0 conn(0x7f05300aef80 0x7f0530073f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.399+0000 7f0534b46640 1 -- 172.21.15.143:0/423857447 >> 172.21.15.143:0/423857447 conn(0x7f053006d610 msgr2=0x7f053006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:11.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.399+0000 7f0534b46640 1 -- 172.21.15.143:0/423857447 shutdown_connections 2024-05-08T10:24:11.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.399+0000 7f0534b46640 1 -- 172.21.15.143:0/423857447 wait complete. 2024-05-08T10:24:11.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.400+0000 7f0534b46640 1 Processor -- start 2024-05-08T10:24:11.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.400+0000 7f0534b46640 1 -- start start 2024-05-08T10:24:11.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f0534b46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300aef80 0x7f05300b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f0534b46640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f05300d2170 0x7f053014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f0534b46640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0530162900 0x7f053015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f0534b46640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f053006f4d0 con 0x7f05300aef80 2024-05-08T10:24:11.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f0534b46640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f05300b5670 con 0x7f05300d2170 2024-05-08T10:24:11.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f0534b46640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f053006f9f0 con 0x7f0530162900 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f052e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300aef80 0x7f05300b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f052e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300aef80 0x7f05300b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40488/0 (socket says 172.21.15.143:40488) 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f052e59c640 1 -- 172.21.15.143:0/2682520617 learned_addr learned my addr 172.21.15.143:0/2682520617 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f0525d9b640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f05300d2170 0x7f053014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f052ed9d640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0530162900 0x7f053015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f052e59c640 1 -- 172.21.15.143:0/2682520617 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0530162900 msgr2=0x7f053015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.401+0000 7f052e59c640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0530162900 0x7f053015daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.402+0000 7f052e59c640 1 -- 172.21.15.143:0/2682520617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f05300d2170 msgr2=0x7f053014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.402+0000 7f052e59c640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f05300d2170 0x7f053014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.402+0000 7f052e59c640 1 -- 172.21.15.143:0/2682520617 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05300b2b80 con 0x7f05300aef80 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.402+0000 7f052e59c640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300aef80 0x7f05300b22a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f052000c3a0 tx=0x7f052000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.402+0000 7f05277fe640 1 -- 172.21.15.143:0/2682520617 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520017070 con 0x7f05300aef80 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.402+0000 7f05277fe640 1 -- 172.21.15.143:0/2682520617 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05200052d0 con 0x7f05300aef80 2024-05-08T10:24:11.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.402+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05300b2e20 con 0x7f05300aef80 2024-05-08T10:24:11.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.402+0000 7f05277fe640 1 -- 172.21.15.143:0/2682520617 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520003830 con 0x7f05300aef80 2024-05-08T10:24:11.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.402+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05300b27e0 con 0x7f05300aef80 2024-05-08T10:24:11.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.403+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f053006a550 con 0x7f05300aef80 2024-05-08T10:24:11.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.404+0000 7f05277fe640 1 -- 172.21.15.143:0/2682520617 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f052001a070 con 0x7f05300aef80 2024-05-08T10:24:11.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.404+0000 7f05277fe640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f05100762d0 0x7f0510078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.404+0000 7f05277fe640 1 -- 172.21.15.143:0/2682520617 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f05200968b0 con 0x7f05300aef80 2024-05-08T10:24:11.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.404+0000 7f0525d9b640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f05100762d0 0x7f0510078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.404+0000 7f0525d9b640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f05100762d0 0x7f0510078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0530071310 tx=0x7f0518009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:11.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.408+0000 7f05277fe640 1 -- 172.21.15.143:0/2682520617 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f052005fbc0 con 0x7f05300aef80 2024-05-08T10:24:11.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.594+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05300b2ff0 con 0x7f05300aef80 2024-05-08T10:24:11.580 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.595+0000 7f05277fe640 1 -- 172.21.15.143:0/2682520617 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f0520068020 con 0x7f05300aef80 2024-05-08T10:24:11.580 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:11.580 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:49.433403+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:23:45.992622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:23:46.737514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:11.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f05100762d0 msgr2=0x7f0510078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f05100762d0 0x7f0510078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0530071310 tx=0x7f0518009190 comp rx=0 tx=0).stop 2024-05-08T10:24:11.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300aef80 msgr2=0x7f05300b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300aef80 0x7f05300b22a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f052000c3a0 tx=0x7f052000c860 comp rx=0 tx=0).stop 2024-05-08T10:24:11.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 shutdown_connections 2024-05-08T10:24:11.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0530162900 0x7f053015daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.582 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f05300d2170 0x7f053014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f05100762d0 0x7f0510078790 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 --2- 172.21.15.143:0/2682520617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05300aef80 0x7f05300b22a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 >> 172.21.15.143:0/2682520617 conn(0x7f053006d610 msgr2=0x7f05300d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:11.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 shutdown_connections 2024-05-08T10:24:11.583 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.597+0000 7f0534b46640 1 -- 172.21.15.143:0/2682520617 wait complete. 2024-05-08T10:24:11.593 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T10:23:42.539787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T10:23:45.992622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T10:23:46.737514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T10:24:11.594 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T10:24:11.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.712+0000 7fc1673da640 1 Processor -- start 2024-05-08T10:24:11.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.712+0000 7fc1673da640 1 -- start start 2024-05-08T10:24:11.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc1673da640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc1600d0a00 0x7fc1600d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc1673da640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc1600d1f30 0x7fc1600d3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc1673da640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1600d0fc0 con 0x7fc16015f5d0 2024-05-08T10:24:11.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc1673da640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc1600d3820 con 0x7fc1600d0a00 2024-05-08T10:24:11.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc1673da640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc1600d2360 con 0x7fc1600d1f30 2024-05-08T10:24:11.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc164975640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc1600d0a00 0x7fc1600d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc164975640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc1600d0a00 0x7fc1600d19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40496/0 (socket says 172.21.15.143:40496) 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc164975640 1 -- 172.21.15.143:0/978954715 learned_addr learned my addr 172.21.15.143:0/978954715 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc164975640 1 -- 172.21.15.143:0/978954715 >> v2:172.21.15.163:3300/0 conn(0x7fc1600d1f30 msgr2=0x7fc1600d3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc165977640 1 --2- 172.21.15.143:0/978954715 >> v2:172.21.15.163:3300/0 conn(0x7fc1600d1f30 0x7fc1600d3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc164975640 1 --2- 172.21.15.143:0/978954715 >> v2:172.21.15.163:3300/0 conn(0x7fc1600d1f30 0x7fc1600d3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc164975640 1 -- 172.21.15.143:0/978954715 >> v1:172.21.15.163:6789/0 conn(0x7fc16015f5d0 legacy=0x7fc1600d5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc164975640 1 -- 172.21.15.143:0/978954715 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1600d12a0 con 0x7fc1600d0a00 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.713+0000 7fc165977640 1 --2- 172.21.15.143:0/978954715 >> v2:172.21.15.163:3300/0 conn(0x7fc1600d1f30 0x7fc1600d3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.714+0000 7fc164975640 1 --2- 172.21.15.143:0/978954715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d0a00 0x7fc1600d19f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc1600d39a0 tx=0x7fc15002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d5834d05e9ab8a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.714+0000 7fc157fff640 1 -- 172.21.15.143:0/978954715 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150037070 con 0x7fc1600d0a00 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.714+0000 7fc157fff640 1 -- 172.21.15.143:0/978954715 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc150032440 con 0x7fc1600d0a00 2024-05-08T10:24:11.700 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.714+0000 7fc157fff640 1 -- 172.21.15.143:0/978954715 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150032810 con 0x7fc1600d0a00 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.715+0000 7fc1673da640 1 -- 172.21.15.143:0/978954715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d0a00 msgr2=0x7fc1600d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.715+0000 7fc1673da640 1 --2- 172.21.15.143:0/978954715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d0a00 0x7fc1600d19f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc1600d39a0 tx=0x7fc15002a270 comp rx=0 tx=0).stop 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.715+0000 7fc1673da640 1 -- 172.21.15.143:0/978954715 shutdown_connections 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.715+0000 7fc1673da640 1 --2- 172.21.15.143:0/978954715 >> v2:172.21.15.163:3300/0 conn(0x7fc1600d1f30 0x7fc1600d3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.715+0000 7fc1673da640 1 --2- 172.21.15.143:0/978954715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d0a00 0x7fc1600d19f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.715+0000 7fc1673da640 1 -- 172.21.15.143:0/978954715 >> 172.21.15.143:0/978954715 conn(0x7fc16009e5e0 msgr2=0x7fc1600d5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.715+0000 7fc1673da640 1 -- 172.21.15.143:0/978954715 shutdown_connections 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.715+0000 7fc1673da640 1 -- 172.21.15.143:0/978954715 wait complete. 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.716+0000 7fc1673da640 1 Processor -- start 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.716+0000 7fc1673da640 1 -- start start 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc1673da640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1600d0a00 0x7fc1601f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc1673da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d1f30 0x7fc1600baac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc1673da640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16015f5d0 0x7fc1600b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc1673da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc16015f9b0 con 0x7fc1600d1f30 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc1673da640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc1600d34b0 con 0x7fc16015f5d0 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc1673da640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc16015fb30 con 0x7fc1600d0a00 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc164975640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d1f30 0x7fc1600baac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc164975640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d1f30 0x7fc1600baac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40506/0 (socket says 172.21.15.143:40506) 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc164975640 1 -- 172.21.15.143:0/185363511 learned_addr learned my addr 172.21.15.143:0/185363511 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc165977640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16015f5d0 0x7fc1600b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc165176640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1600d0a00 0x7fc1601f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc164975640 1 -- 172.21.15.143:0/185363511 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1600d0a00 msgr2=0x7fc1601f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc164975640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1600d0a00 0x7fc1601f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc164975640 1 -- 172.21.15.143:0/185363511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16015f5d0 msgr2=0x7fc1600b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc164975640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16015f5d0 0x7fc1600b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc164975640 1 -- 172.21.15.143:0/185363511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1601f5660 con 0x7fc1600d1f30 2024-05-08T10:24:11.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc164975640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d1f30 0x7fc1600baac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc150000c00 tx=0x7fc1500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:11.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc155ffb640 1 -- 172.21.15.143:0/185363511 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150041020 con 0x7fc1600d1f30 2024-05-08T10:24:11.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc155ffb640 1 -- 172.21.15.143:0/185363511 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc150030970 con 0x7fc1600d1f30 2024-05-08T10:24:11.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc155ffb640 1 -- 172.21.15.143:0/185363511 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150037040 con 0x7fc1600d1f30 2024-05-08T10:24:11.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.717+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1601f59a0 con 0x7fc1600d1f30 2024-05-08T10:24:11.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.718+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16015fe00 con 0x7fc1600d1f30 2024-05-08T10:24:11.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.719+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16006a550 con 0x7fc1600d1f30 2024-05-08T10:24:11.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.719+0000 7fc155ffb640 1 -- 172.21.15.143:0/185363511 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc150044020 con 0x7fc1600d1f30 2024-05-08T10:24:11.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.720+0000 7fc155ffb640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1440762d0 0x7fc144078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:11.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.720+0000 7fc155ffb640 1 -- 172.21.15.143:0/185363511 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc1500b7f20 con 0x7fc1600d1f30 2024-05-08T10:24:11.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.720+0000 7fc165176640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1440762d0 0x7fc144078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:11.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.720+0000 7fc165176640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1440762d0 0x7fc144078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc16015d1d0 tx=0x7fc15c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:11.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.724+0000 7fc155ffb640 1 -- 172.21.15.143:0/185363511 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc15004b030 con 0x7fc1600d1f30 2024-05-08T10:24:11.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.903+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1600b4440 con 0x7fc1600d1f30 2024-05-08T10:24:11.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.903+0000 7fc155ffb640 1 -- 172.21.15.143:0/185363511 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc1601f59a0 con 0x7fc1600d1f30 2024-05-08T10:24:11.889 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 1 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1440762d0 msgr2=0x7fc144078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1440762d0 0x7fc144078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc16015d1d0 tx=0x7fc15c009060 comp rx=0 tx=0).stop 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d1f30 msgr2=0x7fc1600baac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d1f30 0x7fc1600baac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc150000c00 tx=0x7fc1500046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 shutdown_connections 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc16015f5d0 0x7fc1600b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc1440762d0 0x7fc144078790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1600d1f30 0x7fc1600baac0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 --2- 172.21.15.143:0/185363511 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc1600d0a00 0x7fc1601f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:11.891 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 >> 172.21.15.143:0/185363511 conn(0x7fc16009e5e0 msgr2=0x7fc16006d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:11.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.905+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 shutdown_connections 2024-05-08T10:24:11.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:11.906+0000 7fc1673da640 1 -- 172.21.15.143:0/185363511 wait complete. 2024-05-08T10:24:11.902 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T10:24:12.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.018+0000 7f6dbbbaf640 1 Processor -- start 2024-05-08T10:24:12.004 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.019+0000 7f6dbbbaf640 1 -- start start 2024-05-08T10:24:12.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.019+0000 7f6dbbbaf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6db40d2180 0x7f6db40d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.019+0000 7f6dbbbaf640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db40b12b0 con 0x7f6db41563d0 2024-05-08T10:24:12.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.019+0000 7f6dbbbaf640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db40b1590 con 0x7f6db40b0db0 2024-05-08T10:24:12.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.019+0000 7f6dbbbaf640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6db40d2b10 con 0x7f6db40d2180 2024-05-08T10:24:12.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.020+0000 7f6dba14c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6db40d2180 0x7f6db40d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.020+0000 7f6db994b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6db41563d0 0x7f6db4160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:50346/0 (socket says 172.21.15.143:50346) 2024-05-08T10:24:12.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.020+0000 7f6db994b640 1 -- 172.21.15.143:0/1938197928 learned_addr learned my addr 172.21.15.143:0/1938197928 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:12.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.020+0000 7f6dba14c640 1 -- 172.21.15.143:0/1938197928 >> v1:172.21.15.163:6789/0 conn(0x7f6db40b0db0 legacy=0x7f6db4073d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.020+0000 7f6dba14c640 1 -- 172.21.15.143:0/1938197928 >> v1:172.21.15.143:6789/0 conn(0x7f6db41563d0 legacy=0x7f6db4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.020+0000 7f6dba14c640 1 -- 172.21.15.143:0/1938197928 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db415fb00 con 0x7f6db40d2180 2024-05-08T10:24:12.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.020+0000 7f6db8949640 1 -- 172.21.15.143:0/1938197928 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680113491 0 0) 0x7f6db40b12b0 con 0x7f6db41563d0 2024-05-08T10:24:12.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6dba14c640 1 --2- 172.21.15.143:0/1938197928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db40d2180 0x7f6db40d25d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097d0 tx=0x7f6dac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcf200b67467a2f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:12.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6db8949640 1 -- 172.21.15.143:0/1938197928 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac037070 con 0x7f6db40d2180 2024-05-08T10:24:12.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6db8949640 1 -- 172.21.15.143:0/1938197928 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac032440 con 0x7f6db40d2180 2024-05-08T10:24:12.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6db8949640 1 -- 172.21.15.143:0/1938197928 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac032810 con 0x7f6db40d2180 2024-05-08T10:24:12.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/1938197928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db40d2180 msgr2=0x7f6db40d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6dbbbaf640 1 --2- 172.21.15.143:0/1938197928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db40d2180 0x7f6db40d25d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097d0 tx=0x7f6dac02a270 comp rx=0 tx=0).stop 2024-05-08T10:24:12.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/1938197928 shutdown_connections 2024-05-08T10:24:12.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6dbbbaf640 1 --2- 172.21.15.143:0/1938197928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db40d2180 0x7f6db40d25d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/1938197928 >> 172.21.15.143:0/1938197928 conn(0x7f6db406d610 msgr2=0x7f6db406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:12.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/1938197928 shutdown_connections 2024-05-08T10:24:12.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.021+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/1938197928 wait complete. 2024-05-08T10:24:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.022+0000 7f6dbbbaf640 1 Processor -- start 2024-05-08T10:24:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.022+0000 7f6dbbbaf640 1 -- start start 2024-05-08T10:24:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6dbbbaf640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40b0db0 0x7f6db414bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6dbbbaf640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40d2180 0x7f6db414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6dbbbaf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db41563d0 0x7f6db414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6dbbbaf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6db41567b0 con 0x7f6db41563d0 2024-05-08T10:24:12.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6dbbbaf640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6db415fe70 con 0x7f6db40b0db0 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6dbbbaf640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f6db4156930 con 0x7f6db40d2180 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6dba14c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db41563d0 0x7f6db414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6dba14c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db41563d0 0x7f6db414f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40522/0 (socket says 172.21.15.143:40522) 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6dba14c640 1 -- 172.21.15.143:0/2761044000 learned_addr learned my addr 172.21.15.143:0/2761044000 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6db994b640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40b0db0 0x7f6db414bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.023+0000 7f6db914a640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40d2180 0x7f6db414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6dba14c640 1 -- 172.21.15.143:0/2761044000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40d2180 msgr2=0x7f6db414ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6dba14c640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40d2180 0x7f6db414ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6dba14c640 1 -- 172.21.15.143:0/2761044000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40b0db0 msgr2=0x7f6db414bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6dba14c640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40b0db0 0x7f6db414bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6dba14c640 1 -- 172.21.15.143:0/2761044000 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db40b1b80 con 0x7f6db41563d0 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6dba14c640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db41563d0 0x7f6db414f1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0098f0 tx=0x7f6dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:12.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6db27fc640 1 -- 172.21.15.143:0/2761044000 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac037050 con 0x7f6db41563d0 2024-05-08T10:24:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6db27fc640 1 -- 172.21.15.143:0/2761044000 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac038040 con 0x7f6db41563d0 2024-05-08T10:24:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db40b1e60 con 0x7f6db41563d0 2024-05-08T10:24:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6db27fc640 1 -- 172.21.15.143:0/2761044000 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac004490 con 0x7f6db41563d0 2024-05-08T10:24:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.024+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db414f910 con 0x7f6db41563d0 2024-05-08T10:24:12.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.025+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db41622e0 con 0x7f6db41563d0 2024-05-08T10:24:12.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.025+0000 7f6db27fc640 1 -- 172.21.15.143:0/2761044000 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6dac030980 con 0x7f6db41563d0 2024-05-08T10:24:12.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.026+0000 7f6db27fc640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6da0076300 0x7f6da00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.026+0000 7f6db27fc640 1 -- 172.21.15.143:0/2761044000 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6dac0b80c0 con 0x7f6db41563d0 2024-05-08T10:24:12.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.026+0000 7f6db994b640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6da0076300 0x7f6da00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.026+0000 7f6db994b640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6da0076300 0x7f6da00787c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6da4005fd0 tx=0x7f6da4007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:12.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.030+0000 7f6db27fc640 1 -- 172.21.15.143:0/2761044000 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6db41622e0 con 0x7f6db41563d0 2024-05-08T10:24:12.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.208+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6db406a550 con 0x7f6db41563d0 2024-05-08T10:24:12.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.208+0000 7f6db27fc640 1 -- 172.21.15.143:0/2761044000 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6dac032e20 con 0x7f6db41563d0 2024-05-08T10:24:12.194 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 32 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6da0076300 msgr2=0x7f6da00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6da0076300 0x7f6da00787c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6da4005fd0 tx=0x7f6da4007ed0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db41563d0 msgr2=0x7f6db414f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db41563d0 0x7f6db414f1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0098f0 tx=0x7f6dac0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 shutdown_connections 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6da0076300 0x7f6da00787c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6db41563d0 0x7f6db414f1a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6db40d2180 0x7f6db414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 --2- 172.21.15.143:0/2761044000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6db40b0db0 0x7f6db414bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.210+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 >> 172.21.15.143:0/2761044000 conn(0x7f6db406d610 msgr2=0x7f6db40b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.211+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 shutdown_connections 2024-05-08T10:24:12.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.211+0000 7f6dbbbaf640 1 -- 172.21.15.143:0/2761044000 wait complete. 2024-05-08T10:24:12.207 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T10:24:12.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.327+0000 7fbe5f340640 1 Processor -- start 2024-05-08T10:24:12.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.327+0000 7fbe5f340640 1 -- start start 2024-05-08T10:24:12.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.328+0000 7fbe5f340640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe580d2270 0x7fbe580d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.328+0000 7fbe5f340640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbe580afb90 0x7fbe580affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.328+0000 7fbe5f340640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe58070200 con 0x7fbe58145b10 2024-05-08T10:24:12.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.328+0000 7fbe5f340640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fbe58145ef0 con 0x7fbe580afb90 2024-05-08T10:24:12.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.328+0000 7fbe5f340640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbe580710f0 con 0x7fbe580d2270 2024-05-08T10:24:12.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5c8db640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe580d2270 0x7fbe580d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5d8dd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbe580afb90 0x7fbe580affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5d0dc640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fbe58145b10 0x7fbe580b58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:37094/0 (socket says 172.21.15.143:37094) 2024-05-08T10:24:12.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5c8db640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe580d2270 0x7fbe580d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:40552/0 (socket says 172.21.15.143:40552) 2024-05-08T10:24:12.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5d0dc640 1 -- 172.21.15.143:0/1420620445 learned_addr learned my addr 172.21.15.143:0/1420620445 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:12.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5d8dd640 1 -- 172.21.15.143:0/1420620445 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe580d2270 msgr2=0x7fbe580d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:12.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5d8dd640 1 --2- 172.21.15.143:0/1420620445 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe580d2270 0x7fbe580d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5d8dd640 1 -- 172.21.15.143:0/1420620445 >> v1:172.21.15.163:6789/0 conn(0x7fbe58145b10 legacy=0x7fbe580b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5d8dd640 1 -- 172.21.15.143:0/1420620445 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe580704e0 con 0x7fbe580afb90 2024-05-08T10:24:12.315 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.329+0000 7fbe5c8db640 1 --2- 172.21.15.143:0/1420620445 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe580d2270 0x7fbe580d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:12.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.330+0000 7fbe5d8dd640 1 --2- 172.21.15.143:0/1420620445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580afb90 0x7fbe580affc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009d90 tx=0x7fbe5002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6900b79738290a99 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:12.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.330+0000 7fbe4ffff640 1 -- 172.21.15.143:0/1420620445 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe50007740 con 0x7fbe580afb90 2024-05-08T10:24:12.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.330+0000 7fbe4ffff640 1 -- 172.21.15.143:0/1420620445 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe500078e0 con 0x7fbe580afb90 2024-05-08T10:24:12.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.330+0000 7fbe4ffff640 1 -- 172.21.15.143:0/1420620445 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe50007cb0 con 0x7fbe580afb90 2024-05-08T10:24:12.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.331+0000 7fbe5f340640 1 -- 172.21.15.143:0/1420620445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580afb90 msgr2=0x7fbe580affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.331+0000 7fbe5f340640 1 --2- 172.21.15.143:0/1420620445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580afb90 0x7fbe580affc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009d90 tx=0x7fbe5002a660 comp rx=0 tx=0).stop 2024-05-08T10:24:12.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.331+0000 7fbe5f340640 1 -- 172.21.15.143:0/1420620445 shutdown_connections 2024-05-08T10:24:12.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.331+0000 7fbe5f340640 1 --2- 172.21.15.143:0/1420620445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580afb90 0x7fbe580affc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.331+0000 7fbe5f340640 1 --2- 172.21.15.143:0/1420620445 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe580d2270 0x7fbe580d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.331+0000 7fbe5f340640 1 -- 172.21.15.143:0/1420620445 >> 172.21.15.143:0/1420620445 conn(0x7fbe5806d610 msgr2=0x7fbe5806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:12.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.331+0000 7fbe5f340640 1 -- 172.21.15.143:0/1420620445 shutdown_connections 2024-05-08T10:24:12.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.331+0000 7fbe5f340640 1 -- 172.21.15.143:0/1420620445 wait complete. 2024-05-08T10:24:12.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.332+0000 7fbe5f340640 1 Processor -- start 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.332+0000 7fbe5f340640 1 -- start start 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5f340640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe580afb90 0x7fbe5815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5f340640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580d2270 0x7fbe5815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5f340640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe58145b10 0x7fbe5815eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5f340640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58070aa0 con 0x7fbe580afb90 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5f340640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbe580d2bf0 con 0x7fbe580d2270 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5f340640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbe58070d80 con 0x7fbe58145b10 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d0dc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe580afb90 0x7fbe5815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d0dc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe580afb90 0x7fbe5815c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40534/0 (socket says 172.21.15.143:40534) 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d0dc640 1 -- 172.21.15.143:0/1180827903 learned_addr learned my addr 172.21.15.143:0/1180827903 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5c8db640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580d2270 0x7fbe5815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d8dd640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe58145b10 0x7fbe5815eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d0dc640 1 -- 172.21.15.143:0/1180827903 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe58145b10 msgr2=0x7fbe5815eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d0dc640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe58145b10 0x7fbe5815eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d0dc640 1 -- 172.21.15.143:0/1180827903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580d2270 msgr2=0x7fbe5815e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d0dc640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580d2270 0x7fbe5815e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d0dc640 1 -- 172.21.15.143:0/1180827903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5815f0f0 con 0x7fbe580afb90 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5c8db640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580d2270 0x7fbe5815e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5d0dc640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe580afb90 0x7fbe5815c820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe48001eb0 tx=0x7fbe4800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe4dffb640 1 -- 172.21.15.143:0/1180827903 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48017070 con 0x7fbe580afb90 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe4dffb640 1 -- 172.21.15.143:0/1180827903 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe48005d00 con 0x7fbe580afb90 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe580cc020 con 0x7fbe580afb90 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.333+0000 7fbe4dffb640 1 -- 172.21.15.143:0/1180827903 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48007310 con 0x7fbe580afb90 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.334+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe580cb770 con 0x7fbe580afb90 2024-05-08T10:24:12.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.334+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5806a550 con 0x7fbe580afb90 2024-05-08T10:24:12.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.336+0000 7fbe4dffb640 1 -- 172.21.15.143:0/1180827903 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbe4801a070 con 0x7fbe580afb90 2024-05-08T10:24:12.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.336+0000 7fbe4dffb640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe3c0762d0 0x7fbe3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.336+0000 7fbe4dffb640 1 -- 172.21.15.143:0/1180827903 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe480969e0 con 0x7fbe580afb90 2024-05-08T10:24:12.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.336+0000 7fbe5c8db640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe3c0762d0 0x7fbe3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.337+0000 7fbe5c8db640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe3c0762d0 0x7fbe3c078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe5813e000 tx=0x7fbe54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:12.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.341+0000 7fbe4dffb640 1 -- 172.21.15.143:0/1180827903 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbe48060340 con 0x7fbe580afb90 2024-05-08T10:24:12.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.527+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbe5806db20 con 0x7fbe580afb90 2024-05-08T10:24:12.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.527+0000 7fbe4dffb640 1 -- 172.21.15.143:0/1180827903 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fbe4805fc40 con 0x7fbe580afb90 2024-05-08T10:24:12.513 INFO:teuthology.orchestra.run.smithi143.stdout:pg_num: 64 2024-05-08T10:24:12.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe3c0762d0 msgr2=0x7fbe3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe3c0762d0 0x7fbe3c078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe5813e000 tx=0x7fbe54008040 comp rx=0 tx=0).stop 2024-05-08T10:24:12.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe580afb90 msgr2=0x7fbe5815c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe580afb90 0x7fbe5815c820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe48001eb0 tx=0x7fbe4800c890 comp rx=0 tx=0).stop 2024-05-08T10:24:12.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 shutdown_connections 2024-05-08T10:24:12.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe58145b10 0x7fbe5815eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe580d2270 0x7fbe5815e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe3c0762d0 0x7fbe3c078790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 --2- 172.21.15.143:0/1180827903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe580afb90 0x7fbe5815c820 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 >> 172.21.15.143:0/1180827903 conn(0x7fbe5806d610 msgr2=0x7fbe58144dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:12.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 shutdown_connections 2024-05-08T10:24:12.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.530+0000 7fbe5f340640 1 -- 172.21.15.143:0/1180827903 wait complete. 2024-05-08T10:24:12.527 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-05-08T10:24:12.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.645+0000 7fd605d46640 1 Processor -- start 2024-05-08T10:24:12.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.645+0000 7fd605d46640 1 -- start start 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.646+0000 7fd605d46640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd600072510 0x7fd60006fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.646+0000 7fd605d46640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd600070230 0x7fd6000aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.646+0000 7fd605d46640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6000b4050 con 0x7fd60015bf20 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.646+0000 7fd605d46640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd600073f70 con 0x7fd600072510 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.646+0000 7fd605d46640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd6000b4330 con 0x7fd600070230 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.647+0000 7fd5f6ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd600072510 0x7fd60006fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.647+0000 7fd5ff7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd60015bf20 0x7fd600073860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:50362/0 (socket says 172.21.15.143:50362) 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.647+0000 7fd5ff7fe640 1 -- 172.21.15.143:0/650699247 learned_addr learned my addr 172.21.15.143:0/650699247 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.647+0000 7fd5fffff640 1 --2- 172.21.15.143:0/650699247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd600070230 0x7fd6000aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.647+0000 7fd5f6ffd640 1 -- 172.21.15.143:0/650699247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd600070230 msgr2=0x7fd6000aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:12.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.647+0000 7fd5f6ffd640 1 --2- 172.21.15.143:0/650699247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd600070230 0x7fd6000aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.647+0000 7fd5f6ffd640 1 -- 172.21.15.143:0/650699247 >> v1:172.21.15.143:6789/0 conn(0x7fd60015bf20 legacy=0x7fd600073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.647+0000 7fd5f6ffd640 1 -- 172.21.15.143:0/650699247 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6000b4610 con 0x7fd600072510 2024-05-08T10:24:12.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.647+0000 7fd5feffd640 1 -- 172.21.15.143:0/650699247 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1731695254 0 0) 0x7fd6000b4050 con 0x7fd60015bf20 2024-05-08T10:24:12.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.648+0000 7fd5f6ffd640 1 --2- 172.21.15.143:0/650699247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 0x7fd60006fcf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80097a0 tx=0x7fd5e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60788f7914460f2d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:12.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.649+0000 7fd5feffd640 1 -- 172.21.15.143:0/650699247 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8037070 con 0x7fd600072510 2024-05-08T10:24:12.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.649+0000 7fd5feffd640 1 -- 172.21.15.143:0/650699247 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8032440 con 0x7fd600072510 2024-05-08T10:24:12.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.649+0000 7fd5feffd640 1 -- 172.21.15.143:0/650699247 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8032810 con 0x7fd600072510 2024-05-08T10:24:12.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.650+0000 7fd605d46640 1 -- 172.21.15.143:0/650699247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 msgr2=0x7fd60006fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.650+0000 7fd605d46640 1 --2- 172.21.15.143:0/650699247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 0x7fd60006fcf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80097a0 tx=0x7fd5e802a180 comp rx=0 tx=0).stop 2024-05-08T10:24:12.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.650+0000 7fd605d46640 1 -- 172.21.15.143:0/650699247 shutdown_connections 2024-05-08T10:24:12.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.650+0000 7fd605d46640 1 --2- 172.21.15.143:0/650699247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd600070230 0x7fd6000aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.650+0000 7fd605d46640 1 --2- 172.21.15.143:0/650699247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 0x7fd60006fcf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.650+0000 7fd605d46640 1 -- 172.21.15.143:0/650699247 >> 172.21.15.143:0/650699247 conn(0x7fd6000b2bb0 msgr2=0x7fd6000b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:12.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.650+0000 7fd605d46640 1 -- 172.21.15.143:0/650699247 shutdown_connections 2024-05-08T10:24:12.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.650+0000 7fd605d46640 1 -- 172.21.15.143:0/650699247 wait complete. 2024-05-08T10:24:12.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.651+0000 7fd605d46640 1 Processor -- start 2024-05-08T10:24:12.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.651+0000 7fd605d46640 1 -- start start 2024-05-08T10:24:12.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd605d46640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd600070230 0x7fd600150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd605d46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 0x7fd600151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd605d46640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd60015bf20 0x7fd600151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd605d46640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd60015c480 con 0x7fd600072510 2024-05-08T10:24:12.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd605d46640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd60015c300 con 0x7fd600070230 2024-05-08T10:24:12.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd605d46640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd6000aef50 con 0x7fd60015bf20 2024-05-08T10:24:12.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd5f6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 0x7fd600151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd5f6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 0x7fd600151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40554/0 (socket says 172.21.15.143:40554) 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd5f6ffd640 1 -- 172.21.15.143:0/914602957 learned_addr learned my addr 172.21.15.143:0/914602957 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd5fffff640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd60015bf20 0x7fd600151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.652+0000 7fd5ff7fe640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd600070230 0x7fd600150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.653+0000 7fd5f6ffd640 1 -- 172.21.15.143:0/914602957 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd60015bf20 msgr2=0x7fd600151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.653+0000 7fd5f6ffd640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd60015bf20 0x7fd600151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.653+0000 7fd5f6ffd640 1 -- 172.21.15.143:0/914602957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd600070230 msgr2=0x7fd600150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.653+0000 7fd5f6ffd640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd600070230 0x7fd600150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.653+0000 7fd5f6ffd640 1 -- 172.21.15.143:0/914602957 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd600156ac0 con 0x7fd600072510 2024-05-08T10:24:12.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.653+0000 7fd5f6ffd640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 0x7fd600151920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8035040 tx=0x7fd5e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:12.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.655+0000 7fd5fcff9640 1 -- 172.21.15.143:0/914602957 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8037040 con 0x7fd600072510 2024-05-08T10:24:12.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.655+0000 7fd5fcff9640 1 -- 172.21.15.143:0/914602957 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8030500 con 0x7fd600072510 2024-05-08T10:24:12.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.655+0000 7fd5fcff9640 1 -- 172.21.15.143:0/914602957 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8030910 con 0x7fd600072510 2024-05-08T10:24:12.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.655+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd600156da0 con 0x7fd600072510 2024-05-08T10:24:12.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.655+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd600157360 con 0x7fd600072510 2024-05-08T10:24:12.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.656+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60006a4b0 con 0x7fd600072510 2024-05-08T10:24:12.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.656+0000 7fd5fcff9640 1 -- 172.21.15.143:0/914602957 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd5e8044020 con 0x7fd600072510 2024-05-08T10:24:12.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.657+0000 7fd5fcff9640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd5e0076300 0x7fd5e00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:12.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.657+0000 7fd5ff7fe640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd5e0076300 0x7fd5e00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:12.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.657+0000 7fd5fcff9640 1 -- 172.21.15.143:0/914602957 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd5e80b77f0 con 0x7fd600072510 2024-05-08T10:24:12.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.658+0000 7fd5ff7fe640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd5e0076300 0x7fd5e00787c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0007fd0 tx=0x7fd5f0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:12.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.662+0000 7fd5fcff9640 1 -- 172.21.15.143:0/914602957 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd5e8080a70 con 0x7fd600072510 2024-05-08T10:24:12.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:12.924+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) -- 0x7fd6000b37d0 con 0x7fd600072510 2024-05-08T10:24:13.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.654+0000 7fd5fcff9640 1 -- 172.21.15.143:0/914602957 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v40) ==== 126+0+0 (secure 0 0 0) 0x7fd5e8084d70 con 0x7fd600072510 2024-05-08T10:24:13.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd5e0076300 msgr2=0x7fd5e00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:13.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd5e0076300 0x7fd5e00787c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0007fd0 tx=0x7fd5f0007de0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 msgr2=0x7fd600151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:13.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 0x7fd600151920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8035040 tx=0x7fd5e80046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 shutdown_connections 2024-05-08T10:24:13.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd60015bf20 0x7fd600151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd5e0076300 0x7fd5e00787c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd600072510 0x7fd600151920 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 --2- 172.21.15.143:0/914602957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd600070230 0x7fd600150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 >> 172.21.15.143:0/914602957 conn(0x7fd6000b2bb0 msgr2=0x7fd600075410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:13.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 shutdown_connections 2024-05-08T10:24:13.643 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.657+0000 7fd605d46640 1 -- 172.21.15.143:0/914602957 wait complete. 2024-05-08T10:24:13.653 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-08T10:24:13.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.772+0000 7f684c264640 1 Processor -- start 2024-05-08T10:24:13.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.773+0000 7f684c264640 1 -- start start 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.773+0000 7f684c264640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 0x7f68440d2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.773+0000 7f684c264640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f68440d34e0 0x7f68440b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.773+0000 7f684c264640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6844162fd0 con 0x7f68440b68f0 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.773+0000 7f684c264640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f68440d3940 con 0x7f68440d34e0 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.773+0000 7f684c264640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f68440b7070 con 0x7f6844148d90 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.774+0000 7f68497ff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f68440d34e0 0x7f68440b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.774+0000 7f68497ff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f68440d34e0 0x7f68440b63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60218/0 (socket says 172.21.15.143:60218) 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.774+0000 7f68497ff640 1 -- 172.21.15.143:0/3700085638 learned_addr learned my addr 172.21.15.143:0/3700085638 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.774+0000 7f684a000640 1 --2- 172.21.15.143:0/3700085638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 0x7f68440d2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:13.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.774+0000 7f68497ff640 1 -- 172.21.15.143:0/3700085638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 msgr2=0x7f68440d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:13.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.774+0000 7f68497ff640 1 --2- 172.21.15.143:0/3700085638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 0x7f68440d2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.774+0000 7f68497ff640 1 -- 172.21.15.143:0/3700085638 >> v1:172.21.15.143:6789/0 conn(0x7f68440b68f0 legacy=0x7f6844071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:13.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.774+0000 7f68497ff640 1 -- 172.21.15.143:0/3700085638 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68441632b0 con 0x7f68440d34e0 2024-05-08T10:24:13.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.774+0000 7f684a000640 1 --2- 172.21.15.143:0/3700085638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 0x7f68440d2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:13.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f68497ff640 1 --2- 172.21.15.143:0/3700085638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440d34e0 0x7f68440b63b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6838009870 tx=0x7f683802a1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97857e851c570869 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:13.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f6848ffe640 1 -- 172.21.15.143:0/3700085638 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838037070 con 0x7f68440d34e0 2024-05-08T10:24:13.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f6848ffe640 1 -- 172.21.15.143:0/3700085638 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6838032440 con 0x7f68440d34e0 2024-05-08T10:24:13.761 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f6848ffe640 1 -- 172.21.15.143:0/3700085638 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838032810 con 0x7f68440d34e0 2024-05-08T10:24:13.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f684c264640 1 -- 172.21.15.143:0/3700085638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440d34e0 msgr2=0x7f68440b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:13.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f684c264640 1 --2- 172.21.15.143:0/3700085638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440d34e0 0x7f68440b63b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6838009870 tx=0x7f683802a1b0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f684c264640 1 -- 172.21.15.143:0/3700085638 shutdown_connections 2024-05-08T10:24:13.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f684c264640 1 --2- 172.21.15.143:0/3700085638 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440d34e0 0x7f68440b63b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f684c264640 1 --2- 172.21.15.143:0/3700085638 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 0x7f68440d2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.775+0000 7f684c264640 1 -- 172.21.15.143:0/3700085638 >> 172.21.15.143:0/3700085638 conn(0x7f68440b4da0 msgr2=0x7f68440b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:13.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.776+0000 7f684c264640 1 -- 172.21.15.143:0/3700085638 shutdown_connections 2024-05-08T10:24:13.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.776+0000 7f684c264640 1 -- 172.21.15.143:0/3700085638 wait complete. 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.777+0000 7f684c264640 1 Processor -- start 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.777+0000 7f684c264640 1 -- start start 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.777+0000 7f684c264640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440b68f0 0x7f68440cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.777+0000 7f684c264640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68440d34e0 0x7f684415ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.777+0000 7f684c264640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 0x7f68440ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.777+0000 7f684c264640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6844163d90 con 0x7f68440b68f0 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.777+0000 7f684c264640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6844163870 con 0x7f68440d34e0 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.777+0000 7f684c264640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f68440b6d60 con 0x7f6844148d90 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.777+0000 7f684a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440b68f0 0x7f68440cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440b68f0 0x7f68440cfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60222/0 (socket says 172.21.15.143:60222) 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684a000640 1 -- 172.21.15.143:0/3399340378 learned_addr learned my addr 172.21.15.143:0/3399340378 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f68497ff640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68440d34e0 0x7f684415ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684a801640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 0x7f68440ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:13.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684a000640 1 -- 172.21.15.143:0/3399340378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 msgr2=0x7f68440ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684a000640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 0x7f68440ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684a000640 1 -- 172.21.15.143:0/3399340378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68440d34e0 msgr2=0x7f684415ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684a000640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68440d34e0 0x7f684415ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684a000640 1 -- 172.21.15.143:0/3399340378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68440cff90 con 0x7f68440b68f0 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684a000640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440b68f0 0x7f68440cfa50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f683c009fc0 tx=0x7f683c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f68427fc640 1 -- 172.21.15.143:0/3399340378 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c01a070 con 0x7f68440b68f0 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f68427fc640 1 -- 172.21.15.143:0/3399340378 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f683c003bb0 con 0x7f68440b68f0 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68440d0230 con 0x7f68440b68f0 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f68427fc640 1 -- 172.21.15.143:0/3399340378 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c004030 con 0x7f68440b68f0 2024-05-08T10:24:13.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.778+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68440d07f0 con 0x7f68440b68f0 2024-05-08T10:24:13.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.779+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6844075dc0 con 0x7f68440b68f0 2024-05-08T10:24:13.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.780+0000 7f68427fc640 1 -- 172.21.15.143:0/3399340378 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f683c01d070 con 0x7f68440b68f0 2024-05-08T10:24:13.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.780+0000 7f68427fc640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f68300762d0 0x7f6830078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:13.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.780+0000 7f68427fc640 1 -- 172.21.15.143:0/3399340378 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f683c097820 con 0x7f68440b68f0 2024-05-08T10:24:13.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.780+0000 7f68497ff640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f68300762d0 0x7f6830078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:13.767 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.781+0000 7f68497ff640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f68300762d0 0x7f6830078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6838034000 tx=0x7f683802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:13.769 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.784+0000 7f68427fc640 1 -- 172.21.15.143:0/3399340378 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f683c010070 con 0x7f68440b68f0 2024-05-08T10:24:13.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.966+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f684406a550 con 0x7f68440b68f0 2024-05-08T10:24:13.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.969+0000 7f68427fc640 1 -- 172.21.15.143:0/3399340378 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f683c060b30 con 0x7f68440b68f0 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f68300762d0 msgr2=0x7f6830078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f68300762d0 0x7f6830078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6838034000 tx=0x7f683802e000 comp rx=0 tx=0).stop 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440b68f0 msgr2=0x7f68440cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440b68f0 0x7f68440cfa50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f683c009fc0 tx=0x7f683c00d560 comp rx=0 tx=0).stop 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 shutdown_connections 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6844148d90 0x7f68440ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68440d34e0 0x7f684415ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f68300762d0 0x7f6830078790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 --2- 172.21.15.143:0/3399340378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68440b68f0 0x7f68440cfa50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 >> 172.21.15.143:0/3399340378 conn(0x7f68440b4da0 msgr2=0x7f6844160ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:13.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 shutdown_connections 2024-05-08T10:24:13.959 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:13.971+0000 7f684c264640 1 -- 172.21.15.143:0/3399340378 wait complete. 2024-05-08T10:24:13.968 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T10:24:13.968 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T10:24:14.022 DEBUG:teuthology.orchestra.run.smithi163:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T10:24:14.065 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T10:24:14.065 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:14.065 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:14.081 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:14.081 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:14.138 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:14.138 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:14.194 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:24:14.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.349+0000 7fe506340640 1 Processor -- start 2024-05-08T10:24:14.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.349+0000 7fe506340640 1 -- start start 2024-05-08T10:24:14.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe506340640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe5000d1260 0x7fe5000d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe506340640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50015d3d0 0x7fe50006e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe506340640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5000d1b80 con 0x7fe50006e8c0 2024-05-08T10:24:14.337 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe506340640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe5000aff30 con 0x7fe5000d1260 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe506340640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe5000b0210 con 0x7fe50015d3d0 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe4fffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe5000d1260 0x7fe5000d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe5048dd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe50006e8c0 0x7fe50015ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37982/0 (socket says 172.21.15.143:37982) 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe5048dd640 1 -- 172.21.15.143:0/3527371078 learned_addr learned my addr 172.21.15.143:0/3527371078 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe4fffff640 1 -- 172.21.15.143:0/3527371078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50015d3d0 msgr2=0x7fe50006e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.350+0000 7fe4fffff640 1 --2- 172.21.15.143:0/3527371078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50015d3d0 0x7fe50006e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.351+0000 7fe4fffff640 1 -- 172.21.15.143:0/3527371078 >> v1:172.21.15.143:6789/0 conn(0x7fe50006e8c0 legacy=0x7fe50015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.351+0000 7fe4fffff640 1 -- 172.21.15.143:0/3527371078 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5000b04f0 con 0x7fe5000d1260 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.351+0000 7fe4feffd640 1 -- 172.21.15.143:0/3527371078 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157212380 0 0) 0x7fe5000d1b80 con 0x7fe50006e8c0 2024-05-08T10:24:14.338 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.351+0000 7fe4fffff640 1 --2- 172.21.15.143:0/3527371078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5000d1260 0x7fe5000d1640 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00097a0 tx=0x7fe4f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c571d90e551764a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.351+0000 7fe4feffd640 1 -- 172.21.15.143:0/3527371078 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0037070 con 0x7fe5000d1260 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.351+0000 7fe4feffd640 1 -- 172.21.15.143:0/3527371078 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f0032440 con 0x7fe5000d1260 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.351+0000 7fe4feffd640 1 -- 172.21.15.143:0/3527371078 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0032810 con 0x7fe5000d1260 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.352+0000 7fe506340640 1 -- 172.21.15.143:0/3527371078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5000d1260 msgr2=0x7fe5000d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.352+0000 7fe506340640 1 --2- 172.21.15.143:0/3527371078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5000d1260 0x7fe5000d1640 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00097a0 tx=0x7fe4f002a180 comp rx=0 tx=0).stop 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.352+0000 7fe506340640 1 -- 172.21.15.143:0/3527371078 shutdown_connections 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.352+0000 7fe506340640 1 --2- 172.21.15.143:0/3527371078 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe50015d3d0 0x7fe50006e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.352+0000 7fe506340640 1 --2- 172.21.15.143:0/3527371078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5000d1260 0x7fe5000d1640 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.352+0000 7fe506340640 1 -- 172.21.15.143:0/3527371078 >> 172.21.15.143:0/3527371078 conn(0x7fe50006c740 msgr2=0x7fe50006cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.352+0000 7fe506340640 1 -- 172.21.15.143:0/3527371078 shutdown_connections 2024-05-08T10:24:14.339 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.352+0000 7fe506340640 1 -- 172.21.15.143:0/3527371078 wait complete. 2024-05-08T10:24:14.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.353+0000 7fe506340640 1 Processor -- start 2024-05-08T10:24:14.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.353+0000 7fe506340640 1 -- start start 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe506340640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe50006e8c0 0x7fe50014aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe506340640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5000d1260 0x7fe500154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe506340640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe50015d3d0 0x7fe5000b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe506340640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe5000afb50 con 0x7fe50015d3d0 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe506340640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe50015d8b0 con 0x7fe50006e8c0 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe506340640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe5000afcd0 con 0x7fe5000d1260 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe5048dd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe50015d3d0 0x7fe5000b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe5048dd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe50015d3d0 0x7fe5000b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60238/0 (socket says 172.21.15.143:60238) 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe5048dd640 1 -- 172.21.15.143:0/1770116261 learned_addr learned my addr 172.21.15.143:0/1770116261 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe4fffff640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe50006e8c0 0x7fe50014aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe4ff7fe640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5000d1260 0x7fe500154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe5048dd640 1 -- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5000d1260 msgr2=0x7fe500154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.343 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.354+0000 7fe5048dd640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5000d1260 0x7fe500154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe5048dd640 1 -- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe50006e8c0 msgr2=0x7fe50014aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe5048dd640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe50006e8c0 0x7fe50014aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe5048dd640 1 -- 172.21.15.143:0/1770116261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50015e340 con 0x7fe50015d3d0 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe4fffff640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe50006e8c0 0x7fe50014aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe4ff7fe640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5000d1260 0x7fe500154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe5048dd640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe50015d3d0 0x7fe5000b33a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800c6b0 tx=0x7fe4f800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe4fcff9640 1 -- 172.21.15.143:0/1770116261 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8018070 con 0x7fe50015d3d0 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe4fcff9640 1 -- 172.21.15.143:0/1770116261 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f8004da0 con 0x7fe50015d3d0 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe4fcff9640 1 -- 172.21.15.143:0/1770116261 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f800a880 con 0x7fe50015d3d0 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50015e620 con 0x7fe50015d3d0 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.355+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe500155000 con 0x7fe50015d3d0 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.356+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50006a4b0 con 0x7fe50015d3d0 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.357+0000 7fe4fcff9640 1 -- 172.21.15.143:0/1770116261 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe4f801b070 con 0x7fe50015d3d0 2024-05-08T10:24:14.344 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.357+0000 7fe4fcff9640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe4ec0762d0 0x7fe4ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.357+0000 7fe4fffff640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe4ec0762d0 0x7fe4ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.357+0000 7fe4fcff9640 1 -- 172.21.15.143:0/1770116261 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe4f8096bf0 con 0x7fe50015d3d0 2024-05-08T10:24:14.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.358+0000 7fe4fffff640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe4ec0762d0 0x7fe4ec078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0034000 tx=0x7fe4f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:14.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.361+0000 7fe4fcff9640 1 -- 172.21.15.143:0/1770116261 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe4f8060550 con 0x7fe50015d3d0 2024-05-08T10:24:14.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.558+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe500154350 con 0x7fe50015d3d0 2024-05-08T10:24:14.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.558+0000 7fe4fcff9640 1 -- 172.21.15.143:0/1770116261 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe4f805fe50 con 0x7fe50015d3d0 2024-05-08T10:24:14.544 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2024-05-08T10:24:14.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe4ec0762d0 msgr2=0x7fe4ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe4ec0762d0 0x7fe4ec078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0034000 tx=0x7fe4f002e000 comp rx=0 tx=0).stop 2024-05-08T10:24:14.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe50015d3d0 msgr2=0x7fe5000b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe50015d3d0 0x7fe5000b33a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800c6b0 tx=0x7fe4f800cb70 comp rx=0 tx=0).stop 2024-05-08T10:24:14.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 shutdown_connections 2024-05-08T10:24:14.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe4ec0762d0 0x7fe4ec078790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe50015d3d0 0x7fe5000b33a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5000d1260 0x7fe500154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 --2- 172.21.15.143:0/1770116261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe50006e8c0 0x7fe50014aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.560+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 >> 172.21.15.143:0/1770116261 conn(0x7fe50006c740 msgr2=0x7fe50006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:14.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.561+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 shutdown_connections 2024-05-08T10:24:14.547 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.561+0000 7fe506340640 1 -- 172.21.15.143:0/1770116261 wait complete. 2024-05-08T10:24:14.557 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T10:24:14.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:14.557 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-08T10:24:14.583 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:24:14.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:14.584 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T10:24:14.647 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:14.647 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:14.666 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:14.666 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:14.724 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:14.725 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:14.783 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:24:14.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.900+0000 7fcf8b4c4640 1 Processor -- start 2024-05-08T10:24:14.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.900+0000 7fcf8b4c4640 1 -- start start 2024-05-08T10:24:14.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.901+0000 7fcf8b4c4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf840d30a0 0x7fcf840d3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.901+0000 7fcf8b4c4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcf84071f00 0x7fcf84072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.901+0000 7fcf8b4c4640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf840d1b80 con 0x7fcf8415d100 2024-05-08T10:24:14.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.901+0000 7fcf8b4c4640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fcf84072c70 con 0x7fcf84071f00 2024-05-08T10:24:14.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.901+0000 7fcf8b4c4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fcf840d1e00 con 0x7fcf840d30a0 2024-05-08T10:24:14.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.901+0000 7fcf88a5f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf840d30a0 0x7fcf840d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.901+0000 7fcf89260640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fcf8415d100 0x7fcf840d28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:43910/0 (socket says 172.21.15.143:43910) 2024-05-08T10:24:14.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.901+0000 7fcf89a61640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcf84071f00 0x7fcf84072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.901+0000 7fcf89260640 1 -- 172.21.15.143:0/712573871 learned_addr learned my addr 172.21.15.143:0/712573871 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:14.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.902+0000 7fcf7bfff640 1 -- 172.21.15.143:0/712573871 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834644452 0 0) 0x7fcf80001110 con 0x7fcf8415d100 2024-05-08T10:24:14.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.902+0000 7fcf7bfff640 1 -- 172.21.15.143:0/712573871 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf70003520 con 0x7fcf8415d100 2024-05-08T10:24:14.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.902+0000 7fcf89a61640 1 -- 172.21.15.143:0/712573871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf840d30a0 msgr2=0x7fcf840d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:14.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.902+0000 7fcf89a61640 1 --2- 172.21.15.143:0/712573871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf840d30a0 0x7fcf840d3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.902+0000 7fcf89a61640 1 -- 172.21.15.143:0/712573871 >> v1:172.21.15.163:6789/0 conn(0x7fcf8415d100 legacy=0x7fcf840d28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.902+0000 7fcf89a61640 1 -- 172.21.15.143:0/712573871 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf840d20e0 con 0x7fcf84071f00 2024-05-08T10:24:14.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.902+0000 7fcf88a5f640 1 --2- 172.21.15.143:0/712573871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf840d30a0 0x7fcf840d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:14.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf89a61640 1 --2- 172.21.15.143:0/712573871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcf84071f00 0x7fcf84072390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009d90 tx=0x7fcf7c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=237f23f1d225a004 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:14.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf7bfff640 1 -- 172.21.15.143:0/712573871 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c031600 con 0x7fcf84071f00 2024-05-08T10:24:14.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf7bfff640 1 -- 172.21.15.143:0/712573871 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c0317a0 con 0x7fcf84071f00 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf7bfff640 1 -- 172.21.15.143:0/712573871 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c031b50 con 0x7fcf84071f00 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/712573871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcf84071f00 msgr2=0x7fcf84072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf8b4c4640 1 --2- 172.21.15.143:0/712573871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcf84071f00 0x7fcf84072390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009d90 tx=0x7fcf7c02a5d0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/712573871 shutdown_connections 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf8b4c4640 1 --2- 172.21.15.143:0/712573871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcf84071f00 0x7fcf84072390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf8b4c4640 1 --2- 172.21.15.143:0/712573871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf840d30a0 0x7fcf840d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/712573871 >> 172.21.15.143:0/712573871 conn(0x7fcf840706c0 msgr2=0x7fcf84070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/712573871 shutdown_connections 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.903+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/712573871 wait complete. 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf8b4c4640 1 Processor -- start 2024-05-08T10:24:14.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf8b4c4640 1 -- start start 2024-05-08T10:24:14.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf8b4c4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcf84071f00 0x7fcf84145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf8b4c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf840d30a0 0x7fcf84141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf8b4c4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf8415d100 0x7fcf84152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.892 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf8b4c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8415d660 con 0x7fcf840d30a0 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf8b4c4640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8415d4e0 con 0x7fcf84071f00 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf8b4c4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fcf840728d0 con 0x7fcf8415d100 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf88a5f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf840d30a0 0x7fcf84141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf88a5f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf840d30a0 0x7fcf84141f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60240/0 (socket says 172.21.15.143:60240) 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.905+0000 7fcf88a5f640 1 -- 172.21.15.143:0/2304375586 learned_addr learned my addr 172.21.15.143:0/2304375586 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf89a61640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf8415d100 0x7fcf84152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf89260640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcf84071f00 0x7fcf84145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf88a5f640 1 -- 172.21.15.143:0/2304375586 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf8415d100 msgr2=0x7fcf84152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf88a5f640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf8415d100 0x7fcf84152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf88a5f640 1 -- 172.21.15.143:0/2304375586 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcf84071f00 msgr2=0x7fcf84145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf88a5f640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcf84071f00 0x7fcf84145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf88a5f640 1 -- 172.21.15.143:0/2304375586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf84144890 con 0x7fcf840d30a0 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf88a5f640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf840d30a0 0x7fcf84141f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400e960 tx=0x7fcf7400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:14.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf79ffb640 1 -- 172.21.15.143:0/2304375586 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74017070 con 0x7fcf840d30a0 2024-05-08T10:24:14.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf79ffb640 1 -- 172.21.15.143:0/2304375586 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7400ca00 con 0x7fcf840d30a0 2024-05-08T10:24:14.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf84144b70 con 0x7fcf840d30a0 2024-05-08T10:24:14.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf79ffb640 1 -- 172.21.15.143:0/2304375586 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7400cdd0 con 0x7fcf840d30a0 2024-05-08T10:24:14.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.906+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf84145130 con 0x7fcf840d30a0 2024-05-08T10:24:14.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.907+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf84145620 con 0x7fcf840d30a0 2024-05-08T10:24:14.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.908+0000 7fcf79ffb640 1 -- 172.21.15.143:0/2304375586 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf7401a070 con 0x7fcf840d30a0 2024-05-08T10:24:14.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.908+0000 7fcf79ffb640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcf680762d0 0x7fcf68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:14.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.908+0000 7fcf79ffb640 1 -- 172.21.15.143:0/2304375586 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcf740978b0 con 0x7fcf840d30a0 2024-05-08T10:24:14.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.908+0000 7fcf89260640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcf680762d0 0x7fcf68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:14.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.909+0000 7fcf89260640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcf680762d0 0x7fcf68078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcf80005880 tx=0x7fcf80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:14.898 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:14.913+0000 7fcf79ffb640 1 -- 172.21.15.143:0/2304375586 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf74061190 con 0x7fcf840d30a0 2024-05-08T10:24:15.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.105+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcf8406a4b0 con 0x7fcf840d30a0 2024-05-08T10:24:15.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.106+0000 7fcf79ffb640 1 -- 172.21.15.143:0/2304375586 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fcf74060a90 con 0x7fcf840d30a0 2024-05-08T10:24:15.091 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2024-05-08T10:24:15.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcf680762d0 msgr2=0x7fcf68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:15.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcf680762d0 0x7fcf68078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcf80005880 tx=0x7fcf80009040 comp rx=0 tx=0).stop 2024-05-08T10:24:15.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf840d30a0 msgr2=0x7fcf84141f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:15.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf840d30a0 0x7fcf84141f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400e960 tx=0x7fcf7400ee20 comp rx=0 tx=0).stop 2024-05-08T10:24:15.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 shutdown_connections 2024-05-08T10:24:15.093 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcf8415d100 0x7fcf84152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcf680762d0 0x7fcf68078790 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf840d30a0 0x7fcf84141f40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 --2- 172.21.15.143:0/2304375586 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcf84071f00 0x7fcf84145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 >> 172.21.15.143:0/2304375586 conn(0x7fcf840706c0 msgr2=0x7fcf84142ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:15.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 shutdown_connections 2024-05-08T10:24:15.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.108+0000 7fcf8b4c4640 1 -- 172.21.15.143:0/2304375586 wait complete. 2024-05-08T10:24:15.104 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-08T10:24:15.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:15.104 DEBUG:teuthology.orchestra.run.smithi163:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-08T10:24:15.135 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:24:15.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:15.136 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T10:24:15.208 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:15.208 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:15.225 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:15.225 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:15.280 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:15.280 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:15.336 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:24:15.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.493+0000 7f0654d7f640 1 Processor -- start 2024-05-08T10:24:15.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.493+0000 7f0654d7f640 1 -- start start 2024-05-08T10:24:15.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.494+0000 7f0654d7f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f065015f350 0x7f06500bace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.494+0000 7f0654d7f640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f06500b8240 0x7f06500d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.494+0000 7f0654d7f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06500d2250 0x7f06500d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.494+0000 7f0654d7f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f06500b9670 con 0x7f065015f350 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.494+0000 7f0654d7f640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f06500bb220 con 0x7f06500b8240 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.494+0000 7f0654d7f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f06500b8a60 con 0x7f06500d2250 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064e59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f065015f350 0x7f06500bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064e59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f065015f350 0x7f06500bace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60244/0 (socket says 172.21.15.143:60244) 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064e59c640 1 -- 172.21.15.143:0/3011244118 learned_addr learned my addr 172.21.15.143:0/3011244118 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064dd9b640 1 --2- 172.21.15.143:0/3011244118 >> v2:172.21.15.163:3300/0 conn(0x7f06500b8240 0x7f06500d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064ed9d640 1 --2- 172.21.15.143:0/3011244118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06500d2250 0x7f06500d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064e59c640 1 -- 172.21.15.143:0/3011244118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06500d2250 msgr2=0x7f06500d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:15.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064e59c640 1 --2- 172.21.15.143:0/3011244118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06500d2250 0x7f06500d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064e59c640 1 -- 172.21.15.143:0/3011244118 >> v2:172.21.15.163:3300/0 conn(0x7f06500b8240 msgr2=0x7f06500d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064e59c640 1 --2- 172.21.15.143:0/3011244118 >> v2:172.21.15.163:3300/0 conn(0x7f06500b8240 0x7f06500d3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064e59c640 1 -- 172.21.15.143:0/3011244118 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06500b8d40 con 0x7f065015f350 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064dd9b640 1 --2- 172.21.15.143:0/3011244118 >> v2:172.21.15.163:3300/0 conn(0x7f06500b8240 0x7f06500d3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.495+0000 7f064ed9d640 1 --2- 172.21.15.143:0/3011244118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06500d2250 0x7f06500d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f064e59c640 1 --2- 172.21.15.143:0/3011244118 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f065015f350 0x7f06500bace0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06500d34d0 tx=0x7f064802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4040f2d5d20f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f064d59a640 1 -- 172.21.15.143:0/3011244118 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648036070 con 0x7f065015f350 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f064d59a640 1 -- 172.21.15.143:0/3011244118 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0648031600 con 0x7f065015f350 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f064d59a640 1 -- 172.21.15.143:0/3011244118 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06480319d0 con 0x7f065015f350 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f0654d7f640 1 -- 172.21.15.143:0/3011244118 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f065015f350 msgr2=0x7f06500bace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3011244118 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f065015f350 0x7f06500bace0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06500d34d0 tx=0x7f064802a730 comp rx=0 tx=0).stop 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f0654d7f640 1 -- 172.21.15.143:0/3011244118 shutdown_connections 2024-05-08T10:24:15.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3011244118 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06500d2250 0x7f06500d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3011244118 >> v2:172.21.15.163:3300/0 conn(0x7f06500b8240 0x7f06500d3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3011244118 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f065015f350 0x7f06500bace0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.496+0000 7f0654d7f640 1 -- 172.21.15.143:0/3011244118 >> 172.21.15.143:0/3011244118 conn(0x7f0650073e70 msgr2=0x7f0650074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:15.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.497+0000 7f0654d7f640 1 -- 172.21.15.143:0/3011244118 shutdown_connections 2024-05-08T10:24:15.484 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.497+0000 7f0654d7f640 1 -- 172.21.15.143:0/3011244118 wait complete. 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.498+0000 7f0654d7f640 1 Processor -- start 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.498+0000 7f0654d7f640 1 -- start start 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0654d7f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06500b8240 0x7f065015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0654d7f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06500d2250 0x7f06500d50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0654d7f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f065015f350 0x7f06500d5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0654d7f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f06500d3ac0 con 0x7f06500d2250 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0654d7f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f06500b9300 con 0x7f06500b8240 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0654d7f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f065015f730 con 0x7f065015f350 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064dd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06500d2250 0x7f06500d50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064dd9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06500d2250 0x7f06500d50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60256/0 (socket says 172.21.15.143:60256) 2024-05-08T10:24:15.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064dd9b640 1 -- 172.21.15.143:0/3602683238 learned_addr learned my addr 172.21.15.143:0/3602683238 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064e59c640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06500b8240 0x7f065015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064ed9d640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f065015f350 0x7f06500d5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064dd9b640 1 -- 172.21.15.143:0/3602683238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f065015f350 msgr2=0x7f06500d5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064dd9b640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f065015f350 0x7f06500d5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064dd9b640 1 -- 172.21.15.143:0/3602683238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06500b8240 msgr2=0x7f065015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064dd9b640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06500b8240 0x7f065015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064dd9b640 1 -- 172.21.15.143:0/3602683238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06501605c0 con 0x7f06500d2250 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f064dd9b640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06500d2250 0x7f06500d50f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f063800c7f0 tx=0x7f063800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0646ffd640 1 -- 172.21.15.143:0/3602683238 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638015070 con 0x7f06500d2250 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0646ffd640 1 -- 172.21.15.143:0/3602683238 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0638007820 con 0x7f06500d2250 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0646ffd640 1 -- 172.21.15.143:0/3602683238 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638007c10 con 0x7f06500d2250 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06501608a0 con 0x7f06500d2250 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.499+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0650160e60 con 0x7f06500d2250 2024-05-08T10:24:15.488 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.500+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065006a4b0 con 0x7f06500d2250 2024-05-08T10:24:15.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.501+0000 7f0646ffd640 1 -- 172.21.15.143:0/3602683238 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0638018070 con 0x7f06500d2250 2024-05-08T10:24:15.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.501+0000 7f0646ffd640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f06300762d0 0x7f0630078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:15.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.501+0000 7f0646ffd640 1 -- 172.21.15.143:0/3602683238 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0638097860 con 0x7f06500d2250 2024-05-08T10:24:15.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.501+0000 7f064e59c640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f06300762d0 0x7f0630078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:15.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.502+0000 7f064e59c640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f06300762d0 0x7f0630078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0648033000 tx=0x7f0648009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:15.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.506+0000 7f0646ffd640 1 -- 172.21.15.143:0/3602683238 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06380610b0 con 0x7f06500d2250 2024-05-08T10:24:15.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.698+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f06500d4b90 con 0x7f06500d2250 2024-05-08T10:24:15.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.699+0000 7f0646ffd640 1 -- 172.21.15.143:0/3602683238 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f0638097070 con 0x7f06500d2250 2024-05-08T10:24:15.684 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2024-05-08T10:24:15.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.700+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f06300762d0 msgr2=0x7f0630078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:15.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.700+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f06300762d0 0x7f0630078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0648033000 tx=0x7f0648009000 comp rx=0 tx=0).stop 2024-05-08T10:24:15.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06500d2250 msgr2=0x7f06500d50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:15.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06500d2250 0x7f06500d50f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f063800c7f0 tx=0x7f063800ccb0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 shutdown_connections 2024-05-08T10:24:15.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f065015f350 0x7f06500d5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f06300762d0 0x7f0630078790 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06500d2250 0x7f06500d50f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 --2- 172.21.15.143:0/3602683238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06500b8240 0x7f065015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:15.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 >> 172.21.15.143:0/3602683238 conn(0x7f0650073e70 msgr2=0x7f06500d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:15.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 shutdown_connections 2024-05-08T10:24:15.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:15.701+0000 7f0654d7f640 1 -- 172.21.15.143:0/3602683238 wait complete. 2024-05-08T10:24:15.697 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-08T10:24:15.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:15.697 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-08T10:24:15.723 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:24:15.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:15.723 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-08T10:24:15.779 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:15.780 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:15.799 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:15.799 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:15.859 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:15.859 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:15.919 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:24:16.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.036+0000 7f67a0f38640 1 Processor -- start 2024-05-08T10:24:16.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.036+0000 7f67a0f38640 1 -- start start 2024-05-08T10:24:16.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.037+0000 7f67a0f38640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f679c15f350 0x7f679c0bace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.037+0000 7f67a0f38640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f679c0d2250 0x7f679c0d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.037+0000 7f67a0f38640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679c0bb220 con 0x7f679c0b8240 2024-05-08T10:24:16.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.037+0000 7f67a0f38640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f679c0d2c00 con 0x7f679c0d2250 2024-05-08T10:24:16.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.037+0000 7f67a0f38640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f679c0b9670 con 0x7f679c15f350 2024-05-08T10:24:16.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.037+0000 7f679ad9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f679c0d2250 0x7f679c0d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.037+0000 7f679ad9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f679c0d2250 0x7f679c0d26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60260/0 (socket says 172.21.15.143:60260) 2024-05-08T10:24:16.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.037+0000 7f679ad9d640 1 -- 172.21.15.143:0/1657716612 learned_addr learned my addr 172.21.15.143:0/1657716612 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:16.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.038+0000 7f679a59c640 1 --2- 172.21.15.143:0/1657716612 >> v2:172.21.15.163:3300/0 conn(0x7f679c15f350 0x7f679c0bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.038+0000 7f679ad9d640 1 -- 172.21.15.143:0/1657716612 >> v2:172.21.15.163:3300/0 conn(0x7f679c15f350 msgr2=0x7f679c0bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:16.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.038+0000 7f679ad9d640 1 --2- 172.21.15.143:0/1657716612 >> v2:172.21.15.163:3300/0 conn(0x7f679c15f350 0x7f679c0bace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.038+0000 7f679ad9d640 1 -- 172.21.15.143:0/1657716612 >> v1:172.21.15.163:6789/0 conn(0x7f679c0b8240 legacy=0x7f679c0d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:16.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.038+0000 7f679ad9d640 1 -- 172.21.15.143:0/1657716612 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c0b8a60 con 0x7f679c0d2250 2024-05-08T10:24:16.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.038+0000 7f679ad9d640 1 --2- 172.21.15.143:0/1657716612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c0d2250 0x7f679c0d26c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f679c163f80 tx=0x7f679402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7cafbbf3fa3c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:16.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f679959a640 1 -- 172.21.15.143:0/1657716612 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794037070 con 0x7f679c0d2250 2024-05-08T10:24:16.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f679959a640 1 -- 172.21.15.143:0/1657716612 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6794032440 con 0x7f679c0d2250 2024-05-08T10:24:16.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f679959a640 1 -- 172.21.15.143:0/1657716612 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794032810 con 0x7f679c0d2250 2024-05-08T10:24:16.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f67a0f38640 1 -- 172.21.15.143:0/1657716612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c0d2250 msgr2=0x7f679c0d26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f67a0f38640 1 --2- 172.21.15.143:0/1657716612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c0d2250 0x7f679c0d26c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f679c163f80 tx=0x7f679402a250 comp rx=0 tx=0).stop 2024-05-08T10:24:16.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f67a0f38640 1 -- 172.21.15.143:0/1657716612 shutdown_connections 2024-05-08T10:24:16.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f67a0f38640 1 --2- 172.21.15.143:0/1657716612 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c0d2250 0x7f679c0d26c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f67a0f38640 1 --2- 172.21.15.143:0/1657716612 >> v2:172.21.15.163:3300/0 conn(0x7f679c15f350 0x7f679c0bace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f67a0f38640 1 -- 172.21.15.143:0/1657716612 >> 172.21.15.143:0/1657716612 conn(0x7f679c073e70 msgr2=0x7f679c074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:16.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f67a0f38640 1 -- 172.21.15.143:0/1657716612 shutdown_connections 2024-05-08T10:24:16.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.039+0000 7f67a0f38640 1 -- 172.21.15.143:0/1657716612 wait complete. 2024-05-08T10:24:16.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f67a0f38640 1 Processor -- start 2024-05-08T10:24:16.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f67a0f38640 1 -- start start 2024-05-08T10:24:16.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f67a0f38640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f679c0b8240 0x7f679c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.028 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f67a0f38640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f679c0d2250 0x7f679c0d4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f67a0f38640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c15f350 0x7f679c0d4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f67a0f38640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0b9300 con 0x7f679c15f350 2024-05-08T10:24:16.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f67a0f38640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0b9020 con 0x7f679c0d2250 2024-05-08T10:24:16.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f67a0f38640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f679c15f730 con 0x7f679c0b8240 2024-05-08T10:24:16.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f679ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c15f350 0x7f679c0d4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f679ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c15f350 0x7f679c0d4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60270/0 (socket says 172.21.15.143:60270) 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.041+0000 7f679ad9d640 1 -- 172.21.15.143:0/124833548 learned_addr learned my addr 172.21.15.143:0/124833548 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f679ad9d640 1 -- 172.21.15.143:0/124833548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f679c0b8240 msgr2=0x7f679c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f679ad9d640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f679c0b8240 0x7f679c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f679ad9d640 1 -- 172.21.15.143:0/124833548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f679c0d2250 msgr2=0x7f679c0d4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f679ad9d640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f679c0d2250 0x7f679c0d4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f679ad9d640 1 -- 172.21.15.143:0/124833548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c15b5b0 con 0x7f679c15f350 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f679ad9d640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c15f350 0x7f679c0d4850 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67940090b0 tx=0x7f67940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f678affd640 1 -- 172.21.15.143:0/124833548 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794041020 con 0x7f679c15f350 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f678affd640 1 -- 172.21.15.143:0/124833548 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67940306c0 con 0x7f679c15f350 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c0cade0 con 0x7f679c15f350 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f678affd640 1 -- 172.21.15.143:0/124833548 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794037040 con 0x7f679c15f350 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.042+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c0cb3a0 con 0x7f679c15f350 2024-05-08T10:24:16.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.043+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679c06a4b0 con 0x7f679c15f350 2024-05-08T10:24:16.031 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.044+0000 7f678affd640 1 -- 172.21.15.143:0/124833548 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6794044020 con 0x7f679c15f350 2024-05-08T10:24:16.031 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.044+0000 7f678affd640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f677c0762d0 0x7f677c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.031 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.044+0000 7f678affd640 1 -- 172.21.15.143:0/124833548 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f67940b7e00 con 0x7f679c15f350 2024-05-08T10:24:16.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.044+0000 7f679a59c640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f677c0762d0 0x7f677c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.045+0000 7f679a59c640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f677c0762d0 0x7f677c078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f678c0070b0 tx=0x7f678c007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:16.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.049+0000 7f678affd640 1 -- 172.21.15.143:0/124833548 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f679404b030 con 0x7f679c15f350 2024-05-08T10:24:16.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.244+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f679c0bada0 con 0x7f679c15f350 2024-05-08T10:24:16.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.244+0000 7f678affd640 1 -- 172.21.15.143:0/124833548 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f6794081700 con 0x7f679c15f350 2024-05-08T10:24:16.229 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f677c0762d0 msgr2=0x7f677c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f677c0762d0 0x7f677c078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f678c0070b0 tx=0x7f678c007040 comp rx=0 tx=0).stop 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c15f350 msgr2=0x7f679c0d4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c15f350 0x7f679c0d4850 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67940090b0 tx=0x7f67940046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 shutdown_connections 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f677c0762d0 0x7f677c078790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f679c15f350 0x7f679c0d4850 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f679c0d2250 0x7f679c0d4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 --2- 172.21.15.143:0/124833548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f679c0b8240 0x7f679c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 >> 172.21.15.143:0/124833548 conn(0x7f679c073e70 msgr2=0x7f679c0d52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 shutdown_connections 2024-05-08T10:24:16.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.246+0000 7f67a0f38640 1 -- 172.21.15.143:0/124833548 wait complete. 2024-05-08T10:24:16.242 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-08T10:24:16.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:16.243 DEBUG:teuthology.orchestra.run.smithi163:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-08T10:24:16.275 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:24:16.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:16.275 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-08T10:24:16.334 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-08T10:24:16.334 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:16.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.450+0000 7ffb54d2b640 1 Processor -- start 2024-05-08T10:24:16.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.450+0000 7ffb54d2b640 1 -- start start 2024-05-08T10:24:16.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb54d2b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb54d2b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb50163500 0x7ffb50142a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb54d2b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb50142770 con 0x7ffb50142390 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb54d2b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ffb50163d30 con 0x7ffb50163500 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb54d2b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5015f990 con 0x7ffb500b67b0 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb50163500 0x7ffb50142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4e59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ffb50142390 0x7ffb500b60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:37994/0 (socket says 172.21.15.143:37994) 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4e59c640 1 -- 172.21.15.143:0/3813951405 learned_addr learned my addr 172.21.15.143:0/3813951405 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb50163500 0x7ffb50142a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60278/0 (socket says 172.21.15.143:60278) 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4ed9d640 1 -- 172.21.15.143:0/3813951405 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 msgr2=0x7ffb50162fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4dd9b640 1 --2- 172.21.15.143:0/3813951405 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4ed9d640 1 --2- 172.21.15.143:0/3813951405 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50162fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4ed9d640 1 -- 172.21.15.143:0/3813951405 >> v1:172.21.15.143:6789/0 conn(0x7ffb50142390 legacy=0x7ffb500b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4d59a640 1 -- 172.21.15.143:0/3813951405 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243978429 0 0) 0x7ffb50142770 con 0x7ffb50142390 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4ed9d640 1 -- 172.21.15.143:0/3813951405 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5015fc70 con 0x7ffb50163500 2024-05-08T10:24:16.437 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.451+0000 7ffb4dd9b640 1 --2- 172.21.15.143:0/3813951405 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50162fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.452+0000 7ffb4ed9d640 1 --2- 172.21.15.143:0/3813951405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 0x7ffb50142a70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009d90 tx=0x7ffb4802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2489ffe1309fb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.452+0000 7ffb4d59a640 1 -- 172.21.15.143:0/3813951405 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48007740 con 0x7ffb50163500 2024-05-08T10:24:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.452+0000 7ffb4d59a640 1 -- 172.21.15.143:0/3813951405 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb480078e0 con 0x7ffb50163500 2024-05-08T10:24:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.452+0000 7ffb4d59a640 1 -- 172.21.15.143:0/3813951405 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48007cb0 con 0x7ffb50163500 2024-05-08T10:24:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.452+0000 7ffb54d2b640 1 -- 172.21.15.143:0/3813951405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 msgr2=0x7ffb50142a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.452+0000 7ffb54d2b640 1 --2- 172.21.15.143:0/3813951405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 0x7ffb50142a70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009d90 tx=0x7ffb4802a660 comp rx=0 tx=0).stop 2024-05-08T10:24:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.453+0000 7ffb54d2b640 1 -- 172.21.15.143:0/3813951405 shutdown_connections 2024-05-08T10:24:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.453+0000 7ffb54d2b640 1 --2- 172.21.15.143:0/3813951405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 0x7ffb50142a70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.453+0000 7ffb54d2b640 1 --2- 172.21.15.143:0/3813951405 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50162fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.453+0000 7ffb54d2b640 1 -- 172.21.15.143:0/3813951405 >> 172.21.15.143:0/3813951405 conn(0x7ffb500b4da0 msgr2=0x7ffb500b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.453+0000 7ffb54d2b640 1 -- 172.21.15.143:0/3813951405 shutdown_connections 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.453+0000 7ffb54d2b640 1 -- 172.21.15.143:0/3813951405 wait complete. 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.454+0000 7ffb54d2b640 1 Processor -- start 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.454+0000 7ffb54d2b640 1 -- start start 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb54d2b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb54d2b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb50142390 0x7ffb501f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb54d2b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 0x7ffb500b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb54d2b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50160750 con 0x7ffb50163500 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb54d2b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50160230 con 0x7ffb50142390 2024-05-08T10:24:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb54d2b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ffb50163950 con 0x7ffb500b67b0 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 0x7ffb500b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 0x7ffb500b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60282/0 (socket says 172.21.15.143:60282) 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4ed9d640 1 -- 172.21.15.143:0/309153466 learned_addr learned my addr 172.21.15.143:0/309153466 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4e59c640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4dd9b640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb50142390 0x7ffb501f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4ed9d640 1 -- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 msgr2=0x7ffb50142970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4ed9d640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50142970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4ed9d640 1 -- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb50142390 msgr2=0x7ffb501f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4ed9d640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb50142390 0x7ffb501f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4ed9d640 1 -- 172.21.15.143:0/309153466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb500ce500 con 0x7ffb50163500 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4e59c640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4dd9b640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb50142390 0x7ffb501f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb4ed9d640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 0x7ffb500b2dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009d90 tx=0x7ffb48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:16.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb3effd640 1 -- 172.21.15.143:0/309153466 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48040070 con 0x7ffb50163500 2024-05-08T10:24:16.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb3effd640 1 -- 172.21.15.143:0/309153466 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb48031c40 con 0x7ffb50163500 2024-05-08T10:24:16.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb500cdf40 con 0x7ffb50163500 2024-05-08T10:24:16.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb3effd640 1 -- 172.21.15.143:0/309153466 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48003990 con 0x7ffb50163500 2024-05-08T10:24:16.444 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.455+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb50140360 con 0x7ffb50163500 2024-05-08T10:24:16.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.456+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5006a550 con 0x7ffb50163500 2024-05-08T10:24:16.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.457+0000 7ffb3effd640 1 -- 172.21.15.143:0/309153466 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb48039040 con 0x7ffb50163500 2024-05-08T10:24:16.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.458+0000 7ffb3effd640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb300762d0 0x7ffb30078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.458+0000 7ffb3effd640 1 -- 172.21.15.143:0/309153466 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffb480b8570 con 0x7ffb50163500 2024-05-08T10:24:16.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.458+0000 7ffb4e59c640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb300762d0 0x7ffb30078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.458+0000 7ffb4e59c640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb300762d0 0x7ffb30078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffb40000f60 tx=0x7ffb40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:16.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.462+0000 7ffb3effd640 1 -- 172.21.15.143:0/309153466 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffb48081f60 con 0x7ffb50163500 2024-05-08T10:24:16.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.679+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb5006dee0 con 0x7ffb50163500 2024-05-08T10:24:16.665 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.680+0000 7ffb3effd640 1 -- 172.21.15.143:0/309153466 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7ffb48081860 con 0x7ffb50163500 2024-05-08T10:24:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:16.665 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/3021671777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3021671777},{"type":"v1","addr":"172.21.15.163:6834","nonce":3021671777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2147988445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":2147988445},{"type":"v1","addr":"172.21.15.163:6835","nonce":2147988445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/4179295945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":4179295945},{"type":"v1","addr":"172.21.15.143:6836","nonce":4179295945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:23:47.784804+0000","modified":"2024-05-08T10:23:49.788119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-05-08T10:24:16.666 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 6 2024-05-08T10:24:16.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb300762d0 msgr2=0x7ffb30078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb300762d0 0x7ffb30078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffb40000f60 tx=0x7ffb40009040 comp rx=0 tx=0).stop 2024-05-08T10:24:16.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 msgr2=0x7ffb500b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 0x7ffb500b2dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009d90 tx=0x7ffb48004a40 comp rx=0 tx=0).stop 2024-05-08T10:24:16.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 shutdown_connections 2024-05-08T10:24:16.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb300762d0 0x7ffb30078790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb50163500 0x7ffb500b2dd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb50142390 0x7ffb501f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 --2- 172.21.15.143:0/309153466 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb500b67b0 0x7ffb50142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 >> 172.21.15.143:0/309153466 conn(0x7ffb500b4da0 msgr2=0x7ffb5006e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:16.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 shutdown_connections 2024-05-08T10:24:16.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.682+0000 7ffb54d2b640 1 -- 172.21.15.143:0/309153466 wait complete. 2024-05-08T10:24:16.678 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:16.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.793+0000 7fbea53c8640 1 Processor -- start 2024-05-08T10:24:16.779 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.793+0000 7fbea53c8640 1 -- start start 2024-05-08T10:24:16.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.794+0000 7fbea53c8640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbea0140070 0x7fbea0071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.794+0000 7fbea53c8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0142f20 0x7fbea01410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.794+0000 7fbea53c8640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea0140450 con 0x7fbea00722f0 2024-05-08T10:24:16.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.794+0000 7fbea53c8640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fbea0072e50 con 0x7fbea0140070 2024-05-08T10:24:16.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.794+0000 7fbea53c8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbea0072890 con 0x7fbea0142f20 2024-05-08T10:24:16.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9effd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbea0140070 0x7fbea0071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0142f20 0x7fbea01410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9effd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbea0140070 0x7fbea0071db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:36590/0 (socket says 172.21.15.143:36590) 2024-05-08T10:24:16.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9e7fc640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fbea00722f0 0x7fbea0142810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:43914/0 (socket says 172.21.15.143:43914) 2024-05-08T10:24:16.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9effd640 1 -- 172.21.15.143:0/4350754 learned_addr learned my addr 172.21.15.143:0/4350754 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:16.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0142f20 0x7fbea01410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:43378/0 (socket says 172.21.15.143:43378) 2024-05-08T10:24:16.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9effd640 1 -- 172.21.15.143:0/4350754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0142f20 msgr2=0x7fbea01410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:16.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9effd640 1 --2- 172.21.15.143:0/4350754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0142f20 0x7fbea01410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9effd640 1 -- 172.21.15.143:0/4350754 >> v1:172.21.15.163:6789/0 conn(0x7fbea00722f0 legacy=0x7fbea0142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.795+0000 7fbe9effd640 1 -- 172.21.15.143:0/4350754 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea0072b70 con 0x7fbea0140070 2024-05-08T10:24:16.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.796+0000 7fbe9effd640 1 --2- 172.21.15.143:0/4350754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbea0140070 0x7fbea0071db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009e50 tx=0x7fbe9002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=237cda3325c1e0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:16.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.796+0000 7fbe9dffb640 1 -- 172.21.15.143:0/4350754 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90036070 con 0x7fbea0140070 2024-05-08T10:24:16.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.796+0000 7fbe9dffb640 1 -- 172.21.15.143:0/4350754 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe90031600 con 0x7fbea0140070 2024-05-08T10:24:16.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.796+0000 7fbe9dffb640 1 -- 172.21.15.143:0/4350754 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900319d0 con 0x7fbea0140070 2024-05-08T10:24:16.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.796+0000 7fbea53c8640 1 -- 172.21.15.143:0/4350754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbea0140070 msgr2=0x7fbea0071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.797+0000 7fbea53c8640 1 --2- 172.21.15.143:0/4350754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbea0140070 0x7fbea0071db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009e50 tx=0x7fbe9002a5f0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.797+0000 7fbea53c8640 1 -- 172.21.15.143:0/4350754 shutdown_connections 2024-05-08T10:24:16.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.797+0000 7fbea53c8640 1 --2- 172.21.15.143:0/4350754 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0142f20 0x7fbea01410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.797+0000 7fbea53c8640 1 --2- 172.21.15.143:0/4350754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbea0140070 0x7fbea0071db0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.797+0000 7fbea53c8640 1 -- 172.21.15.143:0/4350754 >> 172.21.15.143:0/4350754 conn(0x7fbea00b4da0 msgr2=0x7fbea00b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:16.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.797+0000 7fbea53c8640 1 -- 172.21.15.143:0/4350754 shutdown_connections 2024-05-08T10:24:16.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.797+0000 7fbea53c8640 1 -- 172.21.15.143:0/4350754 wait complete. 2024-05-08T10:24:16.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.798+0000 7fbea53c8640 1 Processor -- start 2024-05-08T10:24:16.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.798+0000 7fbea53c8640 1 -- start start 2024-05-08T10:24:16.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbea53c8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbea00722f0 0x7fbea013d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbea53c8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0140070 0x7fbea01f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbea53c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbea0142f20 0x7fbea0143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbea53c8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01415f0 con 0x7fbea0142f20 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbea53c8640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01435b0 con 0x7fbea00722f0 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbea53c8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fbea0141770 con 0x7fbea0140070 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbea0142f20 0x7fbea0143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbea0142f20 0x7fbea0143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60286/0 (socket says 172.21.15.143:60286) 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9f7fe640 1 -- 172.21.15.143:0/2790626697 learned_addr learned my addr 172.21.15.143:0/2790626697 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9effd640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbea00722f0 0x7fbea013d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9e7fc640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0140070 0x7fbea01f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9f7fe640 1 -- 172.21.15.143:0/2790626697 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0140070 msgr2=0x7fbea01f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9f7fe640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0140070 0x7fbea01f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9f7fe640 1 -- 172.21.15.143:0/2790626697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbea00722f0 msgr2=0x7fbea013d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:16.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9f7fe640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbea00722f0 0x7fbea013d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:16.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9f7fe640 1 -- 172.21.15.143:0/2790626697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea01f6470 con 0x7fbea0142f20 2024-05-08T10:24:16.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe9f7fe640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbea0142f20 0x7fbea0143730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800e7f0 tx=0x7fbe9800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:16.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe877fe640 1 -- 172.21.15.143:0/2790626697 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98017070 con 0x7fbea0142f20 2024-05-08T10:24:16.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe877fe640 1 -- 172.21.15.143:0/2790626697 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9800ee40 con 0x7fbea0142f20 2024-05-08T10:24:16.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea0145b30 con 0x7fbea0142f20 2024-05-08T10:24:16.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbe877fe640 1 -- 172.21.15.143:0/2790626697 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800cb80 con 0x7fbea0142f20 2024-05-08T10:24:16.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.799+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea01460f0 con 0x7fbea0142f20 2024-05-08T10:24:16.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.800+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea006a550 con 0x7fbea0142f20 2024-05-08T10:24:16.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.801+0000 7fbe877fe640 1 -- 172.21.15.143:0/2790626697 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbe9801a070 con 0x7fbea0142f20 2024-05-08T10:24:16.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.801+0000 7fbe877fe640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe8c0762d0 0x7fbe8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:16.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.802+0000 7fbe877fe640 1 -- 172.21.15.143:0/2790626697 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe980973b0 con 0x7fbea0142f20 2024-05-08T10:24:16.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.802+0000 7fbe9effd640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe8c0762d0 0x7fbe8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:16.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.802+0000 7fbe9effd640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe8c0762d0 0x7fbe8c078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe90033000 tx=0x7fbe90009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:16.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:16.806+0000 7fbe877fe640 1 -- 172.21.15.143:0/2790626697 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbe980606c0 con 0x7fbea0142f20 2024-05-08T10:24:17.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.023+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbea013f4b0 con 0x7fbea0142f20 2024-05-08T10:24:17.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.023+0000 7fbe877fe640 1 -- 172.21.15.143:0/2790626697 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7fbe980649c0 con 0x7fbea0142f20 2024-05-08T10:24:17.009 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:17.009 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/3021671777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3021671777},{"type":"v1","addr":"172.21.15.163:6834","nonce":3021671777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2147988445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":2147988445},{"type":"v1","addr":"172.21.15.163:6835","nonce":2147988445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/4179295945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":4179295945},{"type":"v1","addr":"172.21.15.143:6836","nonce":4179295945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:23:47.784804+0000","modified":"2024-05-08T10:23:49.788119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-05-08T10:24:17.009 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 6 2024-05-08T10:24:17.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.025+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe8c0762d0 msgr2=0x7fbe8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.025+0000 7fbea53c8640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe8c0762d0 0x7fbe8c078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe90033000 tx=0x7fbe90009000 comp rx=0 tx=0).stop 2024-05-08T10:24:17.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.025+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbea0142f20 msgr2=0x7fbea0143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.025+0000 7fbea53c8640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbea0142f20 0x7fbea0143730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800e7f0 tx=0x7fbe9800ebf0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.026+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 shutdown_connections 2024-05-08T10:24:17.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.026+0000 7fbea53c8640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fbe8c0762d0 0x7fbe8c078790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.026+0000 7fbea53c8640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbea0142f20 0x7fbea0143730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.026+0000 7fbea53c8640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbea0140070 0x7fbea01f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.026+0000 7fbea53c8640 1 --2- 172.21.15.143:0/2790626697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbea00722f0 0x7fbea013d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.026+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 >> 172.21.15.143:0/2790626697 conn(0x7fbea00b4da0 msgr2=0x7fbea00d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:17.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.026+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 shutdown_connections 2024-05-08T10:24:17.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.026+0000 7fbea53c8640 1 -- 172.21.15.143:0/2790626697 wait complete. 2024-05-08T10:24:17.022 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:17.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.137+0000 7f94d8ea7640 1 Processor -- start 2024-05-08T10:24:17.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.137+0000 7f94d8ea7640 1 -- start start 2024-05-08T10:24:17.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d8ea7640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f94d40b48b0 0x7f94d4166ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d8ea7640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d4072f80 con 0x7f94d415c020 2024-05-08T10:24:17.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d8ea7640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d4074430 con 0x7f94d40ae180 2024-05-08T10:24:17.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d8ea7640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f94d40ae700 con 0x7f94d40b48b0 2024-05-08T10:24:17.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f94d415c020 0x7f94d4073720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38000/0 (socket says 172.21.15.143:38000) 2024-05-08T10:24:17.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d259c640 1 -- 172.21.15.143:0/1211570042 learned_addr learned my addr 172.21.15.143:0/1211570042 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:17.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663286498 0 0) 0x7f94c4001110 con 0x7f94d415c020 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d2d9d640 1 --2- 172.21.15.143:0/1211570042 >> v2:172.21.15.163:3300/0 conn(0x7f94d40b48b0 0x7f94d4166ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94c0003520 con 0x7f94d415c020 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 199997177 0 0) 0x7f94c0003520 con 0x7f94d415c020 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 >> v2:172.21.15.163:3300/0 conn(0x7f94d40b48b0 msgr2=0x7f94d4166ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 --2- 172.21.15.143:0/1211570042 >> v2:172.21.15.163:3300/0 conn(0x7f94d40b48b0 0x7f94d4166ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 >> v1:172.21.15.163:6789/0 conn(0x7f94d40ae180 legacy=0x7f94d40b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d4074710 con 0x7f94d415c020 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f94c40018c0 con 0x7f94d415c020 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 >> v1:172.21.15.143:6789/0 conn(0x7f94d415c020 legacy=0x7f94d4073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94c0003a50 0x7f94c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94c00053c0 0x7f94c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.127 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f94d40ae700 con 0x7f94c0004800 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f94c000c230 con 0x7f94c00053c0 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.138+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f94c000c430 con 0x7f94c0003a50 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.139+0000 7f94cbfff640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.139+0000 7f94d2d9d640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94c00053c0 0x7f94c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.139+0000 7f94d259c640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94c0003a50 0x7f94c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.139+0000 7f94cbfff640 1 -- 172.21.15.143:0/1211570042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94c0003a50 msgr2=0x7f94c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.139+0000 7f94cbfff640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94c0003a50 0x7f94c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.139+0000 7f94cbfff640 1 -- 172.21.15.143:0/1211570042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94c00053c0 msgr2=0x7f94c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.139+0000 7f94cbfff640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94c00053c0 0x7f94c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.139+0000 7f94d2d9d640 1 -- 172.21.15.143:0/1211570042 reap_dead start 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.139+0000 7f94cbfff640 1 -- 172.21.15.143:0/1211570042 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c0003520 con 0x7f94c0004800 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94cbfff640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94c0004c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f94bc001790 tx=0x7f94c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6615b4549d8f0ee2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0013b0 con 0x7f94c0004800 2024-05-08T10:24:17.128 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94bc0052d0 con 0x7f94c0004800 2024-05-08T10:24:17.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d1d9b640 1 -- 172.21.15.143:0/1211570042 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc02aa90 con 0x7f94c0004800 2024-05-08T10:24:17.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d8ea7640 1 -- 172.21.15.143:0/1211570042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 msgr2=0x7f94c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d8ea7640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94c0004c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f94bc001790 tx=0x7f94c0005830 comp rx=0 tx=0).stop 2024-05-08T10:24:17.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d8ea7640 1 -- 172.21.15.143:0/1211570042 shutdown_connections 2024-05-08T10:24:17.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d8ea7640 1 --2- 172.21.15.143:0/1211570042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94c0004c80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d8ea7640 1 -- 172.21.15.143:0/1211570042 >> 172.21.15.143:0/1211570042 conn(0x7f94d406c500 msgr2=0x7f94d406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:17.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d8ea7640 1 -- 172.21.15.143:0/1211570042 shutdown_connections 2024-05-08T10:24:17.129 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.140+0000 7f94d8ea7640 1 -- 172.21.15.143:0/1211570042 wait complete. 2024-05-08T10:24:17.131 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d8ea7640 1 Processor -- start 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d8ea7640 1 -- start start 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d8ea7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94d41550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d8ea7640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94d41f9440 0x7f94d41f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d8ea7640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94d41e9080 0x7f94d41e9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d8ea7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f94d415c400 con 0x7f94c0004800 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d8ea7640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4073290 con 0x7f94d41f9440 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d8ea7640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f94d40b41a0 con 0x7f94d41e9080 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94d41550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94d41550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60296/0 (socket says 172.21.15.143:60296) 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.142+0000 7f94d259c640 1 -- 172.21.15.143:0/3083892384 learned_addr learned my addr 172.21.15.143:0/3083892384 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94d259c640 1 -- 172.21.15.143:0/3083892384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94d41e9080 msgr2=0x7f94d41e9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.132 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94d259c640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94d41e9080 0x7f94d41e9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94d259c640 1 -- 172.21.15.143:0/3083892384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94d41f9440 msgr2=0x7f94d41f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94d259c640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94d41f9440 0x7f94d41f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94d259c640 1 -- 172.21.15.143:0/3083892384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d41559a0 con 0x7f94c0004800 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94d259c640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94d41550a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f94c4000fb0 tx=0x7f94c4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94caffd640 1 -- 172.21.15.143:0/3083892384 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c400f780 con 0x7f94c0004800 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94caffd640 1 -- 172.21.15.143:0/3083892384 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c4018070 con 0x7f94c0004800 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d4155c80 con 0x7f94c0004800 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94caffd640 1 -- 172.21.15.143:0/3083892384 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c400fba0 con 0x7f94c0004800 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.143+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d4156240 con 0x7f94c0004800 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.144+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d406a550 con 0x7f94c0004800 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.145+0000 7f94caffd640 1 -- 172.21.15.143:0/3083892384 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f94c400fd40 con 0x7f94c0004800 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.145+0000 7f94caffd640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94b40762d0 0x7f94b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.145+0000 7f94caffd640 1 -- 172.21.15.143:0/3083892384 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f94c4097530 con 0x7f94c0004800 2024-05-08T10:24:17.133 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.145+0000 7f94cbfff640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94b40762d0 0x7f94b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.146+0000 7f94cbfff640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94b40762d0 0x7f94b4078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94bc032000 tx=0x7f94bc02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:17.134 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.150+0000 7f94caffd640 1 -- 172.21.15.143:0/3083892384 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f94d4072f80 con 0x7f94c0004800 2024-05-08T10:24:17.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.335+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94d40b15b0 con 0x7f94c0004800 2024-05-08T10:24:17.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.336+0000 7f94caffd640 1 -- 172.21.15.143:0/3083892384 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f94c4060e90 con 0x7f94c0004800 2024-05-08T10:24:17.321 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:17.322 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:49.433403+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:23:45.992622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:23:46.737514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:17.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94b40762d0 msgr2=0x7f94b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94b40762d0 0x7f94b4078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94bc032000 tx=0x7f94bc02c000 comp rx=0 tx=0).stop 2024-05-08T10:24:17.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 msgr2=0x7f94d41550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94d41550a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f94c4000fb0 tx=0x7f94c4007430 comp rx=0 tx=0).stop 2024-05-08T10:24:17.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 shutdown_connections 2024-05-08T10:24:17.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94d41e9080 0x7f94d41e9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94d41f9440 0x7f94d41f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f94b40762d0 0x7f94b4078790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 --2- 172.21.15.143:0/3083892384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94c0004800 0x7f94d41550a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 >> 172.21.15.143:0/3083892384 conn(0x7f94d406c500 msgr2=0x7f94d4073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:17.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 shutdown_connections 2024-05-08T10:24:17.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.338+0000 7f94d8ea7640 1 -- 172.21.15.143:0/3083892384 wait complete. 2024-05-08T10:24:17.335 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T10:24:17.335 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:17.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.451+0000 7f9958e23640 1 Processor -- start 2024-05-08T10:24:17.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.451+0000 7f9958e23640 1 -- start start 2024-05-08T10:24:17.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f9958e23640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f99540b54d0 0x7f99540725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f9958e23640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f99540b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f9958e23640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99540b5140 con 0x7f99540b46e0 2024-05-08T10:24:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f9958e23640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f99540af910 con 0x7f99540b54d0 2024-05-08T10:24:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f9958e23640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f99540b4b80 con 0x7f995415b8a0 2024-05-08T10:24:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f994bfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f99540b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f995259c640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f99540b54d0 0x7f99540725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f995259c640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f99540b54d0 0x7f99540725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:36634/0 (socket says 172.21.15.143:36634) 2024-05-08T10:24:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f9952d9d640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f99540b46e0 0x7f99540afda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:43940/0 (socket says 172.21.15.143:43940) 2024-05-08T10:24:17.440 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f995259c640 1 -- 172.21.15.143:0/3048318111 learned_addr learned my addr 172.21.15.143:0/3048318111 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f994bfff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f99540b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:43430/0 (socket says 172.21.15.143:43430) 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f995259c640 1 -- 172.21.15.143:0/3048318111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 msgr2=0x7f99540b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.452+0000 7f995259c640 1 --2- 172.21.15.143:0/3048318111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f99540b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.453+0000 7f995259c640 1 -- 172.21.15.143:0/3048318111 >> v1:172.21.15.163:6789/0 conn(0x7f99540b46e0 legacy=0x7f99540afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.453+0000 7f995259c640 1 -- 172.21.15.143:0/3048318111 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99540b4e60 con 0x7f99540b54d0 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.453+0000 7f9951d9b640 1 -- 172.21.15.143:0/3048318111 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3235254210 0 0) 0x7f99540b5140 con 0x7f99540b46e0 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.453+0000 7f994bfff640 1 --2- 172.21.15.143:0/3048318111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f99540b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.453+0000 7f995259c640 1 --2- 172.21.15.143:0/3048318111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99540b54d0 0x7f99540725a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9944009870 tx=0x7f994402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb17bdfebb1935d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.453+0000 7f9951d9b640 1 -- 172.21.15.143:0/3048318111 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944037070 con 0x7f99540b54d0 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.453+0000 7f9951d9b640 1 -- 172.21.15.143:0/3048318111 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9944032440 con 0x7f99540b54d0 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.453+0000 7f9951d9b640 1 -- 172.21.15.143:0/3048318111 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944032810 con 0x7f99540b54d0 2024-05-08T10:24:17.441 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.454+0000 7f9958e23640 1 -- 172.21.15.143:0/3048318111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99540b54d0 msgr2=0x7f99540725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.454+0000 7f9958e23640 1 --2- 172.21.15.143:0/3048318111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99540b54d0 0x7f99540725a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9944009870 tx=0x7f994402a270 comp rx=0 tx=0).stop 2024-05-08T10:24:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.454+0000 7f9958e23640 1 -- 172.21.15.143:0/3048318111 shutdown_connections 2024-05-08T10:24:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.454+0000 7f9958e23640 1 --2- 172.21.15.143:0/3048318111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f99540b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.454+0000 7f9958e23640 1 --2- 172.21.15.143:0/3048318111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99540b54d0 0x7f99540725a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.454+0000 7f9958e23640 1 -- 172.21.15.143:0/3048318111 >> 172.21.15.143:0/3048318111 conn(0x7f995406c500 msgr2=0x7f995406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.454+0000 7f9958e23640 1 -- 172.21.15.143:0/3048318111 shutdown_connections 2024-05-08T10:24:17.442 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.454+0000 7f9958e23640 1 -- 172.21.15.143:0/3048318111 wait complete. 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.455+0000 7f9958e23640 1 Processor -- start 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.455+0000 7f9958e23640 1 -- start start 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f9958e23640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540b46e0 0x7f9954149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f9958e23640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99540b54d0 0x7f9954160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f9958e23640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f9954160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f9958e23640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9954072c60 con 0x7f99540b46e0 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f9958e23640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9954072ae0 con 0x7f99540b54d0 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f9958e23640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f99540b04b0 con 0x7f995415b8a0 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f995259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540b46e0 0x7f9954149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f995259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540b46e0 0x7f9954149680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60298/0 (socket says 172.21.15.143:60298) 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f995259c640 1 -- 172.21.15.143:0/3478672820 learned_addr learned my addr 172.21.15.143:0/3478672820 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f9952d9d640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f9954160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.456+0000 7f994bfff640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99540b54d0 0x7f9954160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f995259c640 1 -- 172.21.15.143:0/3478672820 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 msgr2=0x7f9954160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f995259c640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f9954160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f995259c640 1 -- 172.21.15.143:0/3478672820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99540b54d0 msgr2=0x7f9954160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f995259c640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99540b54d0 0x7f9954160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f995259c640 1 -- 172.21.15.143:0/3478672820 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9954149e20 con 0x7f99540b46e0 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f995259c640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540b46e0 0x7f9954149680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9944000c00 tx=0x7f99440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:17.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f994affd640 1 -- 172.21.15.143:0/3478672820 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944037040 con 0x7f99540b46e0 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f994affd640 1 -- 172.21.15.143:0/3478672820 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9944042070 con 0x7f99540b46e0 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f994affd640 1 -- 172.21.15.143:0/3478672820 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944030880 con 0x7f99540b46e0 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995414a100 con 0x7f99540b46e0 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.457+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f995414a6c0 con 0x7f99540b46e0 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.458+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995406a550 con 0x7f99540b46e0 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.459+0000 7f994affd640 1 -- 172.21.15.143:0/3478672820 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9944030a20 con 0x7f99540b46e0 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.459+0000 7f994affd640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99340762d0 0x7f9934078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.459+0000 7f994affd640 1 -- 172.21.15.143:0/3478672820 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f99440b7d50 con 0x7f99540b46e0 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.459+0000 7f994bfff640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99340762d0 0x7f9934078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.448 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.460+0000 7f994bfff640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99340762d0 0x7f9934078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f993c009560 tx=0x7f993c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:17.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.463+0000 7f994affd640 1 -- 172.21.15.143:0/3478672820 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f99440bb030 con 0x7f99540b46e0 2024-05-08T10:24:17.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.686+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f995415f470 con 0x7f99540b46e0 2024-05-08T10:24:17.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.687+0000 7f994affd640 1 -- 172.21.15.143:0/3478672820 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7f9944081060 con 0x7f99540b46e0 2024-05-08T10:24:17.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:17.673 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/3021671777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3021671777},{"type":"v1","addr":"172.21.15.163:6834","nonce":3021671777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2147988445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":2147988445},{"type":"v1","addr":"172.21.15.163:6835","nonce":2147988445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/4179295945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":4179295945},{"type":"v1","addr":"172.21.15.143:6836","nonce":4179295945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:23:47.784804+0000","modified":"2024-05-08T10:23:49.788119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-05-08T10:24:17.673 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 6 2024-05-08T10:24:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99340762d0 msgr2=0x7f9934078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99340762d0 0x7f9934078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f993c009560 tx=0x7f993c009190 comp rx=0 tx=0).stop 2024-05-08T10:24:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540b46e0 msgr2=0x7f9954149680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540b46e0 0x7f9954149680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9944000c00 tx=0x7f99440046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 shutdown_connections 2024-05-08T10:24:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f995415b8a0 0x7f9954160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99540b54d0 0x7f9954160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f99340762d0 0x7f9934078790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 --2- 172.21.15.143:0/3478672820 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99540b46e0 0x7f9954149680 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 >> 172.21.15.143:0/3478672820 conn(0x7f995406c500 msgr2=0x7f995415fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:17.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 shutdown_connections 2024-05-08T10:24:17.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.689+0000 7f9958e23640 1 -- 172.21.15.143:0/3478672820 wait complete. 2024-05-08T10:24:17.686 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:17.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.800+0000 7fefb3732640 1 Processor -- start 2024-05-08T10:24:17.785 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.800+0000 7fefb3732640 1 -- start start 2024-05-08T10:24:17.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb3732640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fefac15c020 0x7fefac073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb3732640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefac072f80 con 0x7fefac0ae180 2024-05-08T10:24:17.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb3732640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefac074430 con 0x7fefac0b48b0 2024-05-08T10:24:17.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb3732640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fefac0ae700 con 0x7fefac15c020 2024-05-08T10:24:17.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb14ce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fefac15c020 0x7fefac073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb14ce640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fefac15c020 0x7fefac073720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60312/0 (socket says 172.21.15.143:60312) 2024-05-08T10:24:17.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb14ce640 1 -- 172.21.15.143:0/374516684 learned_addr learned my addr 172.21.15.143:0/374516684 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:17.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb14ce640 1 -- 172.21.15.143:0/374516684 >> v1:172.21.15.163:6789/0 conn(0x7fefac0b48b0 legacy=0x7fefac0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb14ce640 1 -- 172.21.15.143:0/374516684 >> v1:172.21.15.143:6789/0 conn(0x7fefac0ae180 legacy=0x7fefac0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.787 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.801+0000 7fefb14ce640 1 -- 172.21.15.143:0/374516684 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac074710 con 0x7fefac15c020 2024-05-08T10:24:17.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.802+0000 7fefb14ce640 1 --2- 172.21.15.143:0/374516684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac15c020 0x7fefac073720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009870 tx=0x7fefa802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1980dede514ca3a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:17.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.802+0000 7fefa3fff640 1 -- 172.21.15.143:0/374516684 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8037070 con 0x7fefac15c020 2024-05-08T10:24:17.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.802+0000 7fefa3fff640 1 -- 172.21.15.143:0/374516684 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa8032440 con 0x7fefac15c020 2024-05-08T10:24:17.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.802+0000 7fefa3fff640 1 -- 172.21.15.143:0/374516684 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8032810 con 0x7fefac15c020 2024-05-08T10:24:17.788 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.803+0000 7fefb3732640 1 -- 172.21.15.143:0/374516684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac15c020 msgr2=0x7fefac073720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.803+0000 7fefb3732640 1 --2- 172.21.15.143:0/374516684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac15c020 0x7fefac073720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009870 tx=0x7fefa802a1e0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.803+0000 7fefb3732640 1 -- 172.21.15.143:0/374516684 shutdown_connections 2024-05-08T10:24:17.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.803+0000 7fefb3732640 1 --2- 172.21.15.143:0/374516684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac15c020 0x7fefac073720 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.803+0000 7fefb3732640 1 -- 172.21.15.143:0/374516684 >> 172.21.15.143:0/374516684 conn(0x7fefac06c500 msgr2=0x7fefac06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:17.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.803+0000 7fefb3732640 1 -- 172.21.15.143:0/374516684 shutdown_connections 2024-05-08T10:24:17.789 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.803+0000 7fefb3732640 1 -- 172.21.15.143:0/374516684 wait complete. 2024-05-08T10:24:17.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.804+0000 7fefb3732640 1 Processor -- start 2024-05-08T10:24:17.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.804+0000 7fefb3732640 1 -- start start 2024-05-08T10:24:17.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb3732640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac0ae180 0x7fefac1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb3732640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefac0b48b0 0x7fefac15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb3732640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fefac15c020 0x7fefac15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.791 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb3732640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fefac15c400 con 0x7fefac0ae180 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb3732640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fefac073290 con 0x7fefac0b48b0 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb3732640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fefac073c60 con 0x7fefac15c020 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb14ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac0ae180 0x7fefac1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb14ce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac0ae180 0x7fefac1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60314/0 (socket says 172.21.15.143:60314) 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb14ce640 1 -- 172.21.15.143:0/2368161089 learned_addr learned my addr 172.21.15.143:0/2368161089 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb14ce640 1 -- 172.21.15.143:0/2368161089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fefac15c020 msgr2=0x7fefac15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb14ce640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fefac15c020 0x7fefac15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb14ce640 1 -- 172.21.15.143:0/2368161089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefac0b48b0 msgr2=0x7fefac15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb14ce640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefac0b48b0 0x7fefac15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb14ce640 1 -- 172.21.15.143:0/2368161089 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac15abe0 con 0x7fefac0ae180 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb14ce640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac0ae180 0x7fefac1553d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fefa8000c00 tx=0x7fefa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefa1ffb640 1 -- 172.21.15.143:0/2368161089 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8037040 con 0x7fefac0ae180 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefa1ffb640 1 -- 172.21.15.143:0/2368161089 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa8042070 con 0x7fefac0ae180 2024-05-08T10:24:17.792 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefa1ffb640 1 -- 172.21.15.143:0/2368161089 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8030bd0 con 0x7fefac0ae180 2024-05-08T10:24:17.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.805+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefac15ae90 con 0x7fefac0ae180 2024-05-08T10:24:17.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.806+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefac1e5eb0 con 0x7fefac0ae180 2024-05-08T10:24:17.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.807+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefac0aef40 con 0x7fefac0ae180 2024-05-08T10:24:17.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.807+0000 7fefa1ffb640 1 -- 172.21.15.143:0/2368161089 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fefa8047460 con 0x7fefac0ae180 2024-05-08T10:24:17.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.808+0000 7fefa1ffb640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fef900762d0 0x7fef90078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:17.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.808+0000 7fefa1ffb640 1 -- 172.21.15.143:0/2368161089 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fefa80b8210 con 0x7fefac0ae180 2024-05-08T10:24:17.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.808+0000 7fefb0ccd640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fef900762d0 0x7fef90078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:17.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.808+0000 7fefb0ccd640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fef900762d0 0x7fef90078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fefac148080 tx=0x7fef9c007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:17.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:17.812+0000 7fefa1ffb640 1 -- 172.21.15.143:0/2368161089 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fefac0aef40 con 0x7fefac0ae180 2024-05-08T10:24:18.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.036+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefac06f9d0 con 0x7fefac0ae180 2024-05-08T10:24:18.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.037+0000 7fefa1ffb640 1 -- 172.21.15.143:0/2368161089 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7fefa8081c00 con 0x7fefac0ae180 2024-05-08T10:24:18.022 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:18.022 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/3021671777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3021671777},{"type":"v1","addr":"172.21.15.163:6834","nonce":3021671777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2147988445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":2147988445},{"type":"v1","addr":"172.21.15.163:6835","nonce":2147988445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/4179295945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":4179295945},{"type":"v1","addr":"172.21.15.143:6836","nonce":4179295945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:23:47.784804+0000","modified":"2024-05-08T10:23:49.788119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3340158570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3340158570},{"type":"v1","addr":"172.21.15.143:6837","nonce":3340158570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":1}]} 2024-05-08T10:24:18.023 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 6 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fef900762d0 msgr2=0x7fef90078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fef900762d0 0x7fef90078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fefac148080 tx=0x7fef9c007970 comp rx=0 tx=0).stop 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac0ae180 msgr2=0x7fefac1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac0ae180 0x7fefac1553d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fefa8000c00 tx=0x7fefa80046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 shutdown_connections 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fefac15c020 0x7fefac15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefac0b48b0 0x7fefac15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fef900762d0 0x7fef90078790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 --2- 172.21.15.143:0/2368161089 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefac0ae180 0x7fefac1553d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 >> 172.21.15.143:0/2368161089 conn(0x7fefac06c500 msgr2=0x7fefac15d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:18.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 shutdown_connections 2024-05-08T10:24:18.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.039+0000 7fefb3732640 1 -- 172.21.15.143:0/2368161089 wait complete. 2024-05-08T10:24:18.035 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:18.135 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.150+0000 7f1b6fda5640 1 Processor -- start 2024-05-08T10:24:18.136 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.150+0000 7f1b6fda5640 1 -- start start 2024-05-08T10:24:18.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.151+0000 7f1b6fda5640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1b6815c020 0x7f1b68073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.151+0000 7f1b6fda5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1b680ae180 0x7f1b680b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.151+0000 7f1b6fda5640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b68072f80 con 0x7f1b680b46e0 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.151+0000 7f1b6fda5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1b680ae700 con 0x7f1b680ae180 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.151+0000 7f1b6fda5640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f1b68073290 con 0x7f1b6815c020 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.151+0000 7f1b6d340640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1b680ae180 0x7f1b680b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.151+0000 7f1b6d340640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1b680ae180 0x7f1b680b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60320/0 (socket says 172.21.15.143:60320) 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.151+0000 7f1b6d340640 1 -- 172.21.15.143:0/2614960580 learned_addr learned my addr 172.21.15.143:0/2614960580 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.151+0000 7f1b6db41640 1 --2- 172.21.15.143:0/2614960580 >> v2:172.21.15.163:3300/0 conn(0x7f1b6815c020 0x7f1b68073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.152+0000 7f1b6d340640 1 -- 172.21.15.143:0/2614960580 >> v2:172.21.15.163:3300/0 conn(0x7f1b6815c020 msgr2=0x7f1b68073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.152+0000 7f1b6d340640 1 --2- 172.21.15.143:0/2614960580 >> v2:172.21.15.163:3300/0 conn(0x7f1b6815c020 0x7f1b68073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.152+0000 7f1b6d340640 1 -- 172.21.15.143:0/2614960580 >> v1:172.21.15.163:6789/0 conn(0x7f1b680b46e0 legacy=0x7f1b6815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.152+0000 7f1b6d340640 1 -- 172.21.15.143:0/2614960580 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b68074430 con 0x7f1b680ae180 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.152+0000 7f1b6d340640 1 --2- 172.21.15.143:0/2614960580 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680ae180 0x7f1b680b41a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1b680b3f10 tx=0x7f1b5c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cd6687b0dc459 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.152+0000 7f1b6cb3f640 1 -- 172.21.15.143:0/2614960580 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c037070 con 0x7f1b680ae180 2024-05-08T10:24:18.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.152+0000 7f1b6cb3f640 1 -- 172.21.15.143:0/2614960580 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c02ae00 con 0x7f1b680ae180 2024-05-08T10:24:18.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.152+0000 7f1b6cb3f640 1 -- 172.21.15.143:0/2614960580 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c032660 con 0x7f1b680ae180 2024-05-08T10:24:18.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.153+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2614960580 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680ae180 msgr2=0x7f1b680b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.153+0000 7f1b6fda5640 1 --2- 172.21.15.143:0/2614960580 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680ae180 0x7f1b680b41a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1b680b3f10 tx=0x7f1b5c02a0b0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.153+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2614960580 shutdown_connections 2024-05-08T10:24:18.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.153+0000 7f1b6fda5640 1 --2- 172.21.15.143:0/2614960580 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680ae180 0x7f1b680b41a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.153+0000 7f1b6fda5640 1 --2- 172.21.15.143:0/2614960580 >> v2:172.21.15.163:3300/0 conn(0x7f1b6815c020 0x7f1b68073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.153+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2614960580 >> 172.21.15.143:0/2614960580 conn(0x7f1b6806c500 msgr2=0x7f1b6806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:18.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.153+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2614960580 shutdown_connections 2024-05-08T10:24:18.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.153+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2614960580 wait complete. 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.154+0000 7f1b6fda5640 1 Processor -- start 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.154+0000 7f1b6fda5640 1 -- start start 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6fda5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b680ae180 0x7f1b6814e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6fda5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680b46e0 0x7f1b6814b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6fda5640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b6815c020 0x7f1b680b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6fda5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1b680d0860 con 0x7f1b680b46e0 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6fda5640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6815c400 con 0x7f1b6815c020 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6fda5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f1b680b4b70 con 0x7f1b680ae180 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6d340640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680b46e0 0x7f1b6814b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.143 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6d340640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680b46e0 0x7f1b6814b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60330/0 (socket says 172.21.15.143:60330) 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6d340640 1 -- 172.21.15.143:0/2195067035 learned_addr learned my addr 172.21.15.143:0/2195067035 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6db41640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b680ae180 0x7f1b6814e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6e342640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b6815c020 0x7f1b680b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6d340640 1 -- 172.21.15.143:0/2195067035 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b680ae180 msgr2=0x7f1b6814e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6d340640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b680ae180 0x7f1b6814e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6d340640 1 -- 172.21.15.143:0/2195067035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b6815c020 msgr2=0x7f1b680b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6d340640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b6815c020 0x7f1b680b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6d340640 1 -- 172.21.15.143:0/2195067035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6814a960 con 0x7f1b680b46e0 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.155+0000 7f1b6d340640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680b46e0 0x7f1b6814b700 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000c00 tx=0x7f1b5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.156+0000 7f1b5a7fc640 1 -- 172.21.15.143:0/2195067035 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c041030 con 0x7f1b680b46e0 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.156+0000 7f1b5a7fc640 1 -- 172.21.15.143:0/2195067035 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c02ac00 con 0x7f1b680b46e0 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.156+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6814ac40 con 0x7f1b680b46e0 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.156+0000 7f1b5a7fc640 1 -- 172.21.15.143:0/2195067035 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c037040 con 0x7f1b680b46e0 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.156+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b680afe10 con 0x7f1b680b46e0 2024-05-08T10:24:18.144 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.157+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6806a550 con 0x7f1b680b46e0 2024-05-08T10:24:18.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.157+0000 7f1b5a7fc640 1 -- 172.21.15.143:0/2195067035 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b5c044070 con 0x7f1b680b46e0 2024-05-08T10:24:18.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.158+0000 7f1b5a7fc640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1b4c076300 0x7f1b4c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.158+0000 7f1b5a7fc640 1 -- 172.21.15.143:0/2195067035 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1b5c0b76d0 con 0x7f1b680b46e0 2024-05-08T10:24:18.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.158+0000 7f1b6db41640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1b4c076300 0x7f1b4c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.145 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.158+0000 7f1b6db41640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1b4c076300 0x7f1b4c0787c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b64006fd0 tx=0x7f1b64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:18.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.162+0000 7f1b5a7fc640 1 -- 172.21.15.143:0/2195067035 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1b5c04b070 con 0x7f1b680b46e0 2024-05-08T10:24:18.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.343+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b681525a0 con 0x7f1b680b46e0 2024-05-08T10:24:18.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.345+0000 7f1b5a7fc640 1 -- 172.21.15.143:0/2195067035 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f1b68072f80 con 0x7f1b680b46e0 2024-05-08T10:24:18.330 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:18.331 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":20,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:23:49.433403+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:23:45.992622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:23:46.737514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:18.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1b4c076300 msgr2=0x7f1b4c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1b4c076300 0x7f1b4c0787c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b64006fd0 tx=0x7f1b64008040 comp rx=0 tx=0).stop 2024-05-08T10:24:18.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680b46e0 msgr2=0x7f1b6814b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680b46e0 0x7f1b6814b700 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000c00 tx=0x7f1b5c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.333 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 shutdown_connections 2024-05-08T10:24:18.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b6815c020 0x7f1b680b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1b4c076300 0x7f1b4c0787c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b680b46e0 0x7f1b6814b700 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.334 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 --2- 172.21.15.143:0/2195067035 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b680ae180 0x7f1b6814e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 >> 172.21.15.143:0/2195067035 conn(0x7f1b6806c500 msgr2=0x7f1b68073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:18.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 shutdown_connections 2024-05-08T10:24:18.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.347+0000 7f1b6fda5640 1 -- 172.21.15.143:0/2195067035 wait complete. 2024-05-08T10:24:18.343 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T10:24:18.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.460+0000 7f843269c640 1 Processor -- start 2024-05-08T10:24:18.445 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.460+0000 7f843269c640 1 -- start start 2024-05-08T10:24:18.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f843269c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f842c145ee0 0x7f842c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f843269c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 0x7f842c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f843269c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0b7ab0 con 0x7f842c072360 2024-05-08T10:24:18.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f843269c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f842c0727d0 con 0x7f842c145ee0 2024-05-08T10:24:18.446 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f843269c640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f842c0b6a10 con 0x7f842c0b27e0 2024-05-08T10:24:18.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f842bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f842c145ee0 0x7f842c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f842bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f842c145ee0 0x7f842c0b6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60340/0 (socket says 172.21.15.143:60340) 2024-05-08T10:24:18.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f8430c39640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f842c072360 0x7f842c160dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38028/0 (socket says 172.21.15.143:38028) 2024-05-08T10:24:18.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f842bfff640 1 -- 172.21.15.143:0/3332612145 learned_addr learned my addr 172.21.15.143:0/3332612145 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:18.447 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.461+0000 7f842b7fe640 1 --2- 172.21.15.143:0/3332612145 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 0x7f842c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.462+0000 7f842bfff640 1 -- 172.21.15.143:0/3332612145 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 msgr2=0x7f842c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:18.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.462+0000 7f842bfff640 1 --2- 172.21.15.143:0/3332612145 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 0x7f842c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.462+0000 7f842bfff640 1 -- 172.21.15.143:0/3332612145 >> v1:172.21.15.143:6789/0 conn(0x7f842c072360 legacy=0x7f842c160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.462+0000 7f842bfff640 1 -- 172.21.15.143:0/3332612145 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c0b6cf0 con 0x7f842c145ee0 2024-05-08T10:24:18.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.462+0000 7f842bfff640 1 --2- 172.21.15.143:0/3332612145 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c145ee0 0x7f842c0b6110 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f841c009870 tx=0x7f841c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d024a146eafb40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:18.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f842affd640 1 -- 172.21.15.143:0/3332612145 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c037070 con 0x7f842c145ee0 2024-05-08T10:24:18.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f842affd640 1 -- 172.21.15.143:0/3332612145 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841c032440 con 0x7f842c145ee0 2024-05-08T10:24:18.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f842affd640 1 -- 172.21.15.143:0/3332612145 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c032810 con 0x7f842c145ee0 2024-05-08T10:24:18.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f843269c640 1 -- 172.21.15.143:0/3332612145 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c145ee0 msgr2=0x7f842c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f843269c640 1 --2- 172.21.15.143:0/3332612145 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c145ee0 0x7f842c0b6110 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f841c009870 tx=0x7f841c02a270 comp rx=0 tx=0).stop 2024-05-08T10:24:18.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f843269c640 1 -- 172.21.15.143:0/3332612145 shutdown_connections 2024-05-08T10:24:18.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f843269c640 1 --2- 172.21.15.143:0/3332612145 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 0x7f842c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f843269c640 1 --2- 172.21.15.143:0/3332612145 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c145ee0 0x7f842c0b6110 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f843269c640 1 -- 172.21.15.143:0/3332612145 >> 172.21.15.143:0/3332612145 conn(0x7f842c0706c0 msgr2=0x7f842c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:18.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f843269c640 1 -- 172.21.15.143:0/3332612145 shutdown_connections 2024-05-08T10:24:18.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.463+0000 7f843269c640 1 -- 172.21.15.143:0/3332612145 wait complete. 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.464+0000 7f843269c640 1 Processor -- start 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f843269c640 1 -- start start 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f843269c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c072360 0x7f842c141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f843269c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 0x7f842c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f843269c640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f842c145ee0 0x7f842c0b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f843269c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f842c0b7590 con 0x7f842c072360 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f843269c640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f842c0b72b0 con 0x7f842c145ee0 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f843269c640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f842c0b6650 con 0x7f842c0b27e0 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f842bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c072360 0x7f842c141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f842bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c072360 0x7f842c141b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60350/0 (socket says 172.21.15.143:60350) 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f842bfff640 1 -- 172.21.15.143:0/557469154 learned_addr learned my addr 172.21.15.143:0/557469154 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.465+0000 7f842b7fe640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 0x7f842c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f8430c39640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f842c145ee0 0x7f842c0b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f842bfff640 1 -- 172.21.15.143:0/557469154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 msgr2=0x7f842c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f842bfff640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 0x7f842c0aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f842bfff640 1 -- 172.21.15.143:0/557469154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f842c145ee0 msgr2=0x7f842c0b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f842bfff640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f842c145ee0 0x7f842c0b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f842bfff640 1 -- 172.21.15.143:0/557469154 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c0b2290 con 0x7f842c072360 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f842bfff640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c072360 0x7f842c141b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f841c02a2b0 tx=0x7f841c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f8428ff9640 1 -- 172.21.15.143:0/557469154 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c037040 con 0x7f842c072360 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f8428ff9640 1 -- 172.21.15.143:0/557469154 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841c042070 con 0x7f842c072360 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c1421a0 con 0x7f842c072360 2024-05-08T10:24:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f8428ff9640 1 -- 172.21.15.143:0/557469154 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c030880 con 0x7f842c072360 2024-05-08T10:24:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.466+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c142a40 con 0x7f842c072360 2024-05-08T10:24:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.467+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842c0b7cf0 con 0x7f842c072360 2024-05-08T10:24:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.467+0000 7f8428ff9640 1 -- 172.21.15.143:0/557469154 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f841c030a20 con 0x7f842c072360 2024-05-08T10:24:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.468+0000 7f8428ff9640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f840c0762d0 0x7f840c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.468+0000 7f8428ff9640 1 -- 172.21.15.143:0/557469154 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f841c0b7dc0 con 0x7f842c072360 2024-05-08T10:24:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.468+0000 7f842b7fe640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f840c0762d0 0x7f840c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.468+0000 7f842b7fe640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f840c0762d0 0x7f840c078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f842c1408a0 tx=0x7f8414008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:18.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.472+0000 7f8428ff9640 1 -- 172.21.15.143:0/557469154 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f842c0b7cf0 con 0x7f842c072360 2024-05-08T10:24:18.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.691+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f842c06a4b0 con 0x7f842c072360 2024-05-08T10:24:18.676 INFO:tasks.ceph.mon.a.smithi143.stderr:2024-05-08T10:24:18.691+0000 7f4664504640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T10:24:18.678 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.693+0000 7f8428ff9640 1 -- 172.21.15.143:0/557469154 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f841c0817b0 con 0x7f842c072360 2024-05-08T10:24:18.678 INFO:teuthology.orchestra.run.smithi143.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T10:24:18.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.696+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f840c0762d0 msgr2=0x7f840c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.696+0000 7f843269c640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f840c0762d0 0x7f840c078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f842c1408a0 tx=0x7f8414008040 comp rx=0 tx=0).stop 2024-05-08T10:24:18.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c072360 msgr2=0x7f842c141b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c072360 0x7f842c141b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f841c02a2b0 tx=0x7f841c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 shutdown_connections 2024-05-08T10:24:18.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f842c145ee0 0x7f842c0b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f842c0b27e0 0x7f842c0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f840c0762d0 0x7f840c078790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 --2- 172.21.15.143:0/557469154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f842c072360 0x7f842c141b10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 >> 172.21.15.143:0/557469154 conn(0x7f842c0706c0 msgr2=0x7f842c143e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:18.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 shutdown_connections 2024-05-08T10:24:18.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.697+0000 7f843269c640 1 -- 172.21.15.143:0/557469154 wait complete. 2024-05-08T10:24:18.684 INFO:tasks.ceph.mds.a.smithi143.stderr: -6684> 2024-05-08T10:23:52.766+0000 7fbbf121d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T10:24:18.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T10:24:18.716 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2024-05-08T10:24:18.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.811+0000 7f7fd217f640 1 Processor -- start 2024-05-08T10:24:18.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.812+0000 7f7fd217f640 1 -- start start 2024-05-08T10:24:18.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.812+0000 7f7fd217f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7fcc0d2270 0x7f7fcc0d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.812+0000 7f7fd217f640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7fcc0afb90 0x7f7fcc0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.812+0000 7f7fd217f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fcc070200 con 0x7f7fcc145b10 2024-05-08T10:24:18.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.812+0000 7f7fd217f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7fcc0d2c20 con 0x7f7fcc0d2270 2024-05-08T10:24:18.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.812+0000 7f7fd217f640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7fcc145ef0 con 0x7f7fcc0afb90 2024-05-08T10:24:18.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.812+0000 7f7fc2ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7fcc0d2270 0x7f7fcc0d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.813+0000 7f7fcb7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7fcc145b10 0x7f7fcc0b58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38042/0 (socket says 172.21.15.143:38042) 2024-05-08T10:24:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.813+0000 7f7fcb7fe640 1 -- 172.21.15.143:0/3762932267 learned_addr learned my addr 172.21.15.143:0/3762932267 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.813+0000 7f7fc2ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7fcc0d2270 0x7f7fcc0d26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60366/0 (socket says 172.21.15.143:60366) 2024-05-08T10:24:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.813+0000 7f7fcbfff640 1 --2- 172.21.15.143:0/3762932267 >> v2:172.21.15.163:3300/0 conn(0x7f7fcc0afb90 0x7f7fcc0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.813+0000 7f7fc2ffd640 1 -- 172.21.15.143:0/3762932267 >> v2:172.21.15.163:3300/0 conn(0x7f7fcc0afb90 msgr2=0x7f7fcc0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.813+0000 7f7fc2ffd640 1 --2- 172.21.15.143:0/3762932267 >> v2:172.21.15.163:3300/0 conn(0x7f7fcc0afb90 0x7f7fcc0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.813+0000 7f7fc2ffd640 1 -- 172.21.15.143:0/3762932267 >> v1:172.21.15.143:6789/0 conn(0x7f7fcc145b10 legacy=0x7f7fcc0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.813+0000 7f7fcaffd640 1 -- 172.21.15.143:0/3762932267 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444254588 0 0) 0x7f7fcc070200 con 0x7f7fcc145b10 2024-05-08T10:24:18.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.813+0000 7f7fc2ffd640 1 -- 172.21.15.143:0/3762932267 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc0704e0 con 0x7f7fcc0d2270 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fc2ffd640 1 --2- 172.21.15.143:0/3762932267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 0x7f7fcc0d26e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0ce150 tx=0x7f7fb402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41de0aef29c8c03f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fcaffd640 1 -- 172.21.15.143:0/3762932267 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4037070 con 0x7f7fcc0d2270 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fcaffd640 1 -- 172.21.15.143:0/3762932267 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb4032440 con 0x7f7fcc0d2270 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fcaffd640 1 -- 172.21.15.143:0/3762932267 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4032810 con 0x7f7fcc0d2270 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fd217f640 1 -- 172.21.15.143:0/3762932267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 msgr2=0x7f7fcc0d26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fd217f640 1 --2- 172.21.15.143:0/3762932267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 0x7f7fcc0d26e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0ce150 tx=0x7f7fb402a1a0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fd217f640 1 -- 172.21.15.143:0/3762932267 shutdown_connections 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fd217f640 1 --2- 172.21.15.143:0/3762932267 >> v2:172.21.15.163:3300/0 conn(0x7f7fcc0afb90 0x7f7fcc0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fd217f640 1 --2- 172.21.15.143:0/3762932267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 0x7f7fcc0d26e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fd217f640 1 -- 172.21.15.143:0/3762932267 >> 172.21.15.143:0/3762932267 conn(0x7f7fcc06d610 msgr2=0x7f7fcc06da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fd217f640 1 -- 172.21.15.143:0/3762932267 shutdown_connections 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.814+0000 7f7fd217f640 1 -- 172.21.15.143:0/3762932267 wait complete. 2024-05-08T10:24:18.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.816+0000 7f7fd217f640 1 Processor -- start 2024-05-08T10:24:18.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.816+0000 7f7fd217f640 1 -- start start 2024-05-08T10:24:18.804 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.816+0000 7f7fd217f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fcc0afb90 0x7f7fcc1365d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.816+0000 7f7fd217f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 0x7f7fcc0d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.816+0000 7f7fd217f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fcc145b10 0x7f7fcc09be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.816+0000 7f7fd217f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc070aa0 con 0x7f7fcc0d2270 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.816+0000 7f7fd217f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc0710f0 con 0x7f7fcc145b10 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fd217f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7fcc070d80 con 0x7f7fcc0afb90 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 0x7f7fcc0d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc2ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 0x7f7fcc0d06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60376/0 (socket says 172.21.15.143:60376) 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc2ffd640 1 -- 172.21.15.143:0/3150772069 learned_addr learned my addr 172.21.15.143:0/3150772069 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fcbfff640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fcc145b10 0x7f7fcc09be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fcb7fe640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fcc0afb90 0x7f7fcc1365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc2ffd640 1 -- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fcc0afb90 msgr2=0x7f7fcc1365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc2ffd640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fcc0afb90 0x7f7fcc1365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc2ffd640 1 -- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fcc145b10 msgr2=0x7f7fcc09be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc2ffd640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fcc145b10 0x7f7fcc09be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc2ffd640 1 -- 172.21.15.143:0/3150772069 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc136b10 con 0x7f7fcc0d2270 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fcb7fe640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fcc0afb90 0x7f7fcc1365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fcbfff640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fcc145b10 0x7f7fcc09be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc2ffd640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 0x7f7fcc0d06c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000c00 tx=0x7f7fb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc8ff9640 1 -- 172.21.15.143:0/3150772069 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4037040 con 0x7f7fcc0d2270 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc8ff9640 1 -- 172.21.15.143:0/3150772069 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb4042070 con 0x7f7fcc0d2270 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc133ff0 con 0x7f7fcc0d2270 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fc8ff9640 1 -- 172.21.15.143:0/3150772069 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4030960 con 0x7f7fcc0d2270 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.817+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc1345b0 con 0x7f7fcc0d2270 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.818+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fcc0b6c30 con 0x7f7fcc0d2270 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.819+0000 7f7fc8ff9640 1 -- 172.21.15.143:0/3150772069 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7fb4030b00 con 0x7f7fcc0d2270 2024-05-08T10:24:18.806 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.819+0000 7f7fc8ff9640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7fac0762d0 0x7f7fac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:18.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.819+0000 7f7fc8ff9640 1 -- 172.21.15.143:0/3150772069 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f7fb40b7f90 con 0x7f7fcc0d2270 2024-05-08T10:24:18.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.819+0000 7f7fcb7fe640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7fac0762d0 0x7f7fac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:18.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.820+0000 7f7fcb7fe640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7fac0762d0 0x7f7fac078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc000f60 tx=0x7f7fbc007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:18.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:18.823+0000 7f7fc8ff9640 1 -- 172.21.15.143:0/3150772069 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7fcc0b6c30 con 0x7f7fcc0d2270 2024-05-08T10:24:19.029 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.044+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7fcc0b6540 con 0x7f7fcc0d2270 2024-05-08T10:24:19.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.695+0000 7f7fc8ff9640 1 -- 172.21.15.143:0/3150772069 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f7fcc136b10 con 0x7f7fcc0d2270 2024-05-08T10:24:19.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7fac0762d0 msgr2=0x7f7fac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:19.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7fac0762d0 0x7f7fac078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc000f60 tx=0x7f7fbc007cc0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 msgr2=0x7f7fcc0d06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:19.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 0x7f7fcc0d06c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000c00 tx=0x7f7fb40046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 shutdown_connections 2024-05-08T10:24:19.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fcc145b10 0x7f7fcc09be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7fac0762d0 0x7f7fac078790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fcc0d2270 0x7f7fcc0d06c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 --2- 172.21.15.143:0/3150772069 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fcc0afb90 0x7f7fcc1365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 >> 172.21.15.143:0/3150772069 conn(0x7f7fcc06d610 msgr2=0x7f7fcc0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:19.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 shutdown_connections 2024-05-08T10:24:19.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.697+0000 7f7fd217f640 1 -- 172.21.15.143:0/3150772069 wait complete. 2024-05-08T10:24:19.695 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T10:24:19.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.857+0000 7ffb38759640 1 Processor -- start 2024-05-08T10:24:19.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.857+0000 7ffb38759640 1 -- start start 2024-05-08T10:24:19.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb38759640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 0x7ffb3006fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:19.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb38759640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb300af9b0 0x7ffb3015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:19.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb38759640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3015c500 con 0x7ffb300b0390 2024-05-08T10:24:19.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb38759640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ffb300afe90 con 0x7ffb300af9b0 2024-05-08T10:24:19.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb38759640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ffb300b49d0 con 0x7ffb3015c120 2024-05-08T10:24:19.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb36cf6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb300af9b0 0x7ffb3015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:19.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb36cf6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb300af9b0 0x7ffb3015fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60382/0 (socket says 172.21.15.143:60382) 2024-05-08T10:24:19.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb35cf4640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ffb300b0390 0x7ffb300b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38056/0 (socket says 172.21.15.143:38056) 2024-05-08T10:24:19.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb36cf6640 1 -- 172.21.15.143:0/3177855843 learned_addr learned my addr 172.21.15.143:0/3177855843 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:19.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.858+0000 7ffb364f5640 1 --2- 172.21.15.143:0/3177855843 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 0x7ffb3006fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:19.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.859+0000 7ffb36cf6640 1 -- 172.21.15.143:0/3177855843 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 msgr2=0x7ffb3006fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:19.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.859+0000 7ffb36cf6640 1 --2- 172.21.15.143:0/3177855843 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 0x7ffb3006fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.859+0000 7ffb36cf6640 1 -- 172.21.15.143:0/3177855843 >> v1:172.21.15.143:6789/0 conn(0x7ffb300b0390 legacy=0x7ffb300b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:19.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.859+0000 7ffb36cf6640 1 -- 172.21.15.143:0/3177855843 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb300b4cb0 con 0x7ffb300af9b0 2024-05-08T10:24:19.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.859+0000 7ffb354f3640 1 -- 172.21.15.143:0/3177855843 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632434852 0 0) 0x7ffb3015c500 con 0x7ffb300b0390 2024-05-08T10:24:19.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.859+0000 7ffb36cf6640 1 --2- 172.21.15.143:0/3177855843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300af9b0 0x7ffb3015fc60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800d150 tx=0x7ffb2802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc90a899881a177b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:19.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.859+0000 7ffb354f3640 1 -- 172.21.15.143:0/3177855843 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28039070 con 0x7ffb300af9b0 2024-05-08T10:24:19.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.859+0000 7ffb354f3640 1 -- 172.21.15.143:0/3177855843 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb28009600 con 0x7ffb300af9b0 2024-05-08T10:24:19.846 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.859+0000 7ffb354f3640 1 -- 172.21.15.143:0/3177855843 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb280099d0 con 0x7ffb300af9b0 2024-05-08T10:24:19.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.860+0000 7ffb38759640 1 -- 172.21.15.143:0/3177855843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300af9b0 msgr2=0x7ffb3015fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.860+0000 7ffb38759640 1 --2- 172.21.15.143:0/3177855843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300af9b0 0x7ffb3015fc60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800d150 tx=0x7ffb2802c890 comp rx=0 tx=0).stop 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.860+0000 7ffb38759640 1 -- 172.21.15.143:0/3177855843 shutdown_connections 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.860+0000 7ffb38759640 1 --2- 172.21.15.143:0/3177855843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300af9b0 0x7ffb3015fc60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.860+0000 7ffb38759640 1 --2- 172.21.15.143:0/3177855843 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 0x7ffb3006fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.860+0000 7ffb38759640 1 -- 172.21.15.143:0/3177855843 >> 172.21.15.143:0/3177855843 conn(0x7ffb300b2b40 msgr2=0x7ffb300b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.860+0000 7ffb38759640 1 -- 172.21.15.143:0/3177855843 shutdown_connections 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.860+0000 7ffb38759640 1 -- 172.21.15.143:0/3177855843 wait complete. 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.861+0000 7ffb38759640 1 Processor -- start 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.861+0000 7ffb38759640 1 -- start start 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb38759640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb300af9b0 0x7ffb30149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb38759640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300b0390 0x7ffb3009ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:19.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb38759640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 0x7ffb30156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb38759640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffb301601a0 con 0x7ffb300b0390 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb38759640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300b5bc0 con 0x7ffb300af9b0 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb38759640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ffb30160320 con 0x7ffb3015c120 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb35cf4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300b0390 0x7ffb3009ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb35cf4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300b0390 0x7ffb3009ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60384/0 (socket says 172.21.15.143:60384) 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb35cf4640 1 -- 172.21.15.143:0/1825676087 learned_addr learned my addr 172.21.15.143:0/1825676087 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb36cf6640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 0x7ffb30156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb364f5640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb300af9b0 0x7ffb30149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb35cf4640 1 -- 172.21.15.143:0/1825676087 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 msgr2=0x7ffb30156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb35cf4640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 0x7ffb30156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb35cf4640 1 -- 172.21.15.143:0/1825676087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb300af9b0 msgr2=0x7ffb30149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb35cf4640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb300af9b0 0x7ffb30149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:19.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.862+0000 7ffb35cf4640 1 -- 172.21.15.143:0/1825676087 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3009e680 con 0x7ffb300b0390 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.863+0000 7ffb35cf4640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300b0390 0x7ffb3009ba10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000c480 tx=0x7ffb2000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.863+0000 7ffb26ffd640 1 -- 172.21.15.143:0/1825676087 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20018070 con 0x7ffb300b0390 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.863+0000 7ffb26ffd640 1 -- 172.21.15.143:0/1825676087 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb200074e0 con 0x7ffb300b0390 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.863+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb3009e960 con 0x7ffb300b0390 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.863+0000 7ffb26ffd640 1 -- 172.21.15.143:0/1825676087 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20004a20 con 0x7ffb300b0390 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.863+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb3009bf50 con 0x7ffb300b0390 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.864+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb3006a550 con 0x7ffb300b0390 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.864+0000 7ffb26ffd640 1 -- 172.21.15.143:0/1825676087 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb2001b070 con 0x7ffb300b0390 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.865+0000 7ffb26ffd640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb140762d0 0x7ffb14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.865+0000 7ffb26ffd640 1 -- 172.21.15.143:0/1825676087 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7ffb20096940 con 0x7ffb300b0390 2024-05-08T10:24:19.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.865+0000 7ffb364f5640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb140762d0 0x7ffb14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:19.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.865+0000 7ffb364f5640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb140762d0 0x7ffb14078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0079a0 tx=0x7ffb2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:19.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:19.869+0000 7ffb26ffd640 1 -- 172.21.15.143:0/1825676087 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffb2005fcb0 con 0x7ffb300b0390 2024-05-08T10:24:20.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.049+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffb3015c8f0 con 0x7ffb300b0390 2024-05-08T10:24:20.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.989+0000 7ffb26ffd640 1 -- 172.21.15.143:0/1825676087 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7ffb20063fb0 con 0x7ffb300b0390 2024-05-08T10:24:20.975 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' removed 2024-05-08T10:24:20.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb140762d0 msgr2=0x7ffb14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb140762d0 0x7ffb14078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0079a0 tx=0x7ffb2c008040 comp rx=0 tx=0).stop 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300b0390 msgr2=0x7ffb3009ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300b0390 0x7ffb3009ba10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000c480 tx=0x7ffb2000c940 comp rx=0 tx=0).stop 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 shutdown_connections 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3015c120 0x7ffb30156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffb140762d0 0x7ffb14078790 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb300b0390 0x7ffb3009ba10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 --2- 172.21.15.143:0/1825676087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb300af9b0 0x7ffb30149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 >> 172.21.15.143:0/1825676087 conn(0x7ffb300b2b40 msgr2=0x7ffb3006e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 shutdown_connections 2024-05-08T10:24:20.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:20.993+0000 7ffb38759640 1 -- 172.21.15.143:0/1825676087 wait complete. 2024-05-08T10:24:20.994 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T10:24:21.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.117+0000 7f095e5f2640 1 Processor -- start 2024-05-08T10:24:21.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.117+0000 7f095e5f2640 1 -- start start 2024-05-08T10:24:21.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f095e5f2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f09581563d0 0x7f0958160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f095e5f2640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09580b12b0 con 0x7f09580d2180 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f095e5f2640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09580b1590 con 0x7f09580b0db0 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f095e5f2640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f095815fe70 con 0x7f09581563d0 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f0957fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f09581563d0 0x7f0958160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f0957fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f09581563d0 0x7f0958160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60390/0 (socket says 172.21.15.143:60390) 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f0957fff640 1 -- 172.21.15.143:0/3063432326 learned_addr learned my addr 172.21.15.143:0/3063432326 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f095cb8f640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f09580d2180 0x7f0958162fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:38068/0 (socket says 172.21.15.143:38068) 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f0957fff640 1 -- 172.21.15.143:0/3063432326 >> v1:172.21.15.163:6789/0 conn(0x7f09580b0db0 legacy=0x7f0958073d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f0957fff640 1 -- 172.21.15.143:0/3063432326 >> v1:172.21.15.143:6789/0 conn(0x7f09580d2180 legacy=0x7f0958162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f0956ffd640 1 -- 172.21.15.143:0/3063432326 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578215709 0 0) 0x7f09580b12b0 con 0x7f09580d2180 2024-05-08T10:24:21.104 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.118+0000 7f0957fff640 1 -- 172.21.15.143:0/3063432326 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095815fb00 con 0x7f09581563d0 2024-05-08T10:24:21.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.119+0000 7f0957fff640 1 --2- 172.21.15.143:0/3063432326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09581563d0 0x7f0958160300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f09480098a0 tx=0x7f094802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78391bbd79b5c0d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:21.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.119+0000 7f0956ffd640 1 -- 172.21.15.143:0/3063432326 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948037070 con 0x7f09581563d0 2024-05-08T10:24:21.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.119+0000 7f0956ffd640 1 -- 172.21.15.143:0/3063432326 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0948032440 con 0x7f09581563d0 2024-05-08T10:24:21.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.119+0000 7f0956ffd640 1 -- 172.21.15.143:0/3063432326 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948032810 con 0x7f09581563d0 2024-05-08T10:24:21.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.120+0000 7f095e5f2640 1 -- 172.21.15.143:0/3063432326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09581563d0 msgr2=0x7f0958160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:21.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.120+0000 7f095e5f2640 1 --2- 172.21.15.143:0/3063432326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09581563d0 0x7f0958160300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f09480098a0 tx=0x7f094802a290 comp rx=0 tx=0).stop 2024-05-08T10:24:21.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.120+0000 7f095e5f2640 1 -- 172.21.15.143:0/3063432326 shutdown_connections 2024-05-08T10:24:21.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.120+0000 7f095e5f2640 1 --2- 172.21.15.143:0/3063432326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09581563d0 0x7f0958160300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:21.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.120+0000 7f095e5f2640 1 -- 172.21.15.143:0/3063432326 >> 172.21.15.143:0/3063432326 conn(0x7f095806d610 msgr2=0x7f095806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:21.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.120+0000 7f095e5f2640 1 -- 172.21.15.143:0/3063432326 shutdown_connections 2024-05-08T10:24:21.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.120+0000 7f095e5f2640 1 -- 172.21.15.143:0/3063432326 wait complete. 2024-05-08T10:24:21.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.121+0000 7f095e5f2640 1 Processor -- start 2024-05-08T10:24:21.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f095e5f2640 1 -- start start 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f095e5f2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09580b0db0 0x7f0958152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f095e5f2640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09580d2180 0x7f09580b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f095e5f2640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09581563d0 0x7f09580b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f095e5f2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f09581567b0 con 0x7f09580b0db0 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f095e5f2640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0958160840 con 0x7f09581563d0 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f095e5f2640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0958156930 con 0x7f09580d2180 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f0957fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09580b0db0 0x7f0958152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f0957fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09580b0db0 0x7f0958152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60394/0 (socket says 172.21.15.143:60394) 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.122+0000 7f0957fff640 1 -- 172.21.15.143:0/903387988 learned_addr learned my addr 172.21.15.143:0/903387988 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f095cb8f640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09581563d0 0x7f09580b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f09577fe640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09580d2180 0x7f09580b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f0957fff640 1 -- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09580d2180 msgr2=0x7f09580b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:21.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f0957fff640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09580d2180 0x7f09580b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f0957fff640 1 -- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09581563d0 msgr2=0x7f09580b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f0957fff640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09581563d0 0x7f09580b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f0957fff640 1 -- 172.21.15.143:0/903387988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095815c4e0 con 0x7f09580b0db0 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f095cb8f640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09581563d0 0x7f09580b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f09577fe640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09580d2180 0x7f09580b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f0957fff640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09580b0db0 0x7f0958152320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f09480090b0 tx=0x7f09480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f0954ff9640 1 -- 172.21.15.143:0/903387988 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948041070 con 0x7f09580b0db0 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f0954ff9640 1 -- 172.21.15.143:0/903387988 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094803c890 con 0x7f09580b0db0 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0958152860 con 0x7f09580b0db0 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f0954ff9640 1 -- 172.21.15.143:0/903387988 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948037040 con 0x7f09580b0db0 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.123+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0958158da0 con 0x7f09580b0db0 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.124+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095806a550 con 0x7f09580b0db0 2024-05-08T10:24:21.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.125+0000 7f0954ff9640 1 -- 172.21.15.143:0/903387988 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0948044070 con 0x7f09580b0db0 2024-05-08T10:24:21.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.125+0000 7f0954ff9640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0944076300 0x7f09440787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:21.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.125+0000 7f0954ff9640 1 -- 172.21.15.143:0/903387988 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5357+0+0 (secure 0 0 0) 0x7f09480b7e80 con 0x7f09580b0db0 2024-05-08T10:24:21.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.125+0000 7f09577fe640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0944076300 0x7f09440787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:21.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.126+0000 7f09577fe640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0944076300 0x7f09440787c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09580b4860 tx=0x7f094c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:21.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.130+0000 7f0954ff9640 1 -- 172.21.15.143:0/903387988 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0948081940 con 0x7f09580b0db0 2024-05-08T10:24:21.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.313+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f095806ff60 con 0x7f09580b0db0 2024-05-08T10:24:21.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.991+0000 7f0954ff9640 1 -- 172.21.15.143:0/903387988 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7f0948081240 con 0x7f09580b0db0 2024-05-08T10:24:21.976 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' removed 2024-05-08T10:24:21.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.993+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0944076300 msgr2=0x7f09440787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:21.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.993+0000 7f095e5f2640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0944076300 0x7f09440787c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09580b4860 tx=0x7f094c008040 comp rx=0 tx=0).stop 2024-05-08T10:24:21.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.993+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09580b0db0 msgr2=0x7f0958152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:21.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.993+0000 7f095e5f2640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09580b0db0 0x7f0958152320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f09480090b0 tx=0x7f09480046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:21.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.994+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 shutdown_connections 2024-05-08T10:24:21.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.994+0000 7f095e5f2640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09581563d0 0x7f09580b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:21.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.994+0000 7f095e5f2640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f09580d2180 0x7f09580b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:21.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.994+0000 7f095e5f2640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0944076300 0x7f09440787c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:21.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.994+0000 7f095e5f2640 1 --2- 172.21.15.143:0/903387988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09580b0db0 0x7f0958152320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:21.979 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.994+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 >> 172.21.15.143:0/903387988 conn(0x7f095806d610 msgr2=0x7f0958161260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:21.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.994+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 shutdown_connections 2024-05-08T10:24:21.980 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:21.994+0000 7f095e5f2640 1 -- 172.21.15.143:0/903387988 wait complete. 2024-05-08T10:24:21.993 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T10:24:21.993 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-08T10:24:21.994 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T10:24:21.994 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:24:21.994 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T10:24:21.994 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-08T10:24:21.994 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T10:24:21.994 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:24:21.994 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T10:24:21.995 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-08T10:24:21.995 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T10:24:21.995 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:24:21.995 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T10:24:21.995 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-08T10:24:21.995 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T10:24:21.995 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:24:22.004 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T10:24:22.004 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T10:24:22.005 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T10:24:22.005 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T10:24:22.008 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T10:24:22.009 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T10:24:22.009 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T10:24:22.009 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T10:24:22.047 INFO:tasks.ceph.mds.c:Started 2024-05-08T10:24:22.048 DEBUG:teuthology.parallel:result is None 2024-05-08T10:24:22.048 INFO:tasks.ceph.mds.a:Started 2024-05-08T10:24:22.048 DEBUG:teuthology.parallel:result is None 2024-05-08T10:24:22.051 INFO:tasks.ceph.mds.b:Started 2024-05-08T10:24:22.051 DEBUG:teuthology.parallel:result is None 2024-05-08T10:24:22.052 INFO:tasks.ceph.mds.d:Started 2024-05-08T10:24:22.052 DEBUG:teuthology.parallel:result is None 2024-05-08T10:24:22.052 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-08T10:24:22.126 INFO:tasks.ceph.mds.c.smithi143.stdout:starting mds.c at 2024-05-08T10:24:22.126 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2024-05-08T10:24:22.132 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2024-05-08T10:24:22.132 INFO:tasks.ceph.mds.d.smithi163.stdout:starting mds.d at 2024-05-08T10:24:22.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.175+0000 7f3eb83ef640 1 Processor -- start 2024-05-08T10:24:22.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.175+0000 7f3eb83ef640 1 -- start start 2024-05-08T10:24:22.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb83ef640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb015f350 0x7f3eb00bace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:22.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb83ef640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3eb00b8240 0x7f3eb00d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb83ef640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3eb00d2250 0x7f3eb00d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb83ef640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb00b9670 con 0x7f3eb00b8240 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb83ef640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb00bb220 con 0x7f3eb00d2250 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb83ef640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb00b8a60 con 0x7f3eb015f350 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb598a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3eb00b8240 0x7f3eb00d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb598a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3eb00b8240 0x7f3eb00d3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60434/0 (socket says 172.21.15.143:60434) 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb598a640 1 -- 172.21.15.143:0/2793070930 learned_addr learned my addr 172.21.15.143:0/2793070930 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb698c640 1 --2- 172.21.15.143:0/2793070930 >> v2:172.21.15.163:3300/0 conn(0x7f3eb00d2250 0x7f3eb00d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb618b640 1 --2- 172.21.15.143:0/2793070930 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb015f350 0x7f3eb00bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb598a640 1 -- 172.21.15.143:0/2793070930 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb015f350 msgr2=0x7f3eb00bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb598a640 1 --2- 172.21.15.143:0/2793070930 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb015f350 0x7f3eb00bace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb598a640 1 -- 172.21.15.143:0/2793070930 >> v2:172.21.15.163:3300/0 conn(0x7f3eb00d2250 msgr2=0x7f3eb00d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb598a640 1 --2- 172.21.15.143:0/2793070930 >> v2:172.21.15.163:3300/0 conn(0x7f3eb00d2250 0x7f3eb00d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb598a640 1 -- 172.21.15.143:0/2793070930 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb00b8d40 con 0x7f3eb00b8240 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.176+0000 7f3eb698c640 1 --2- 172.21.15.143:0/2793070930 >> v2:172.21.15.163:3300/0 conn(0x7f3eb00d2250 0x7f3eb00d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.177+0000 7f3eb598a640 1 --2- 172.21.15.143:0/2793070930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00b8240 0x7f3eb00d3580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00c8bd0 tx=0x7f3ea002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c752e42b08e97c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.177+0000 7f3eb5189640 1 -- 172.21.15.143:0/2793070930 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0037070 con 0x7f3eb00b8240 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.177+0000 7f3eb5189640 1 -- 172.21.15.143:0/2793070930 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea0032440 con 0x7f3eb00b8240 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.177+0000 7f3eb5189640 1 -- 172.21.15.143:0/2793070930 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0032810 con 0x7f3eb00b8240 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.178+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2793070930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00b8240 msgr2=0x7f3eb00d3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.178+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2793070930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00b8240 0x7f3eb00d3580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00c8bd0 tx=0x7f3ea002a270 comp rx=0 tx=0).stop 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.178+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2793070930 shutdown_connections 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.178+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2793070930 >> v2:172.21.15.163:3300/0 conn(0x7f3eb00d2250 0x7f3eb00d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.178+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2793070930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00b8240 0x7f3eb00d3580 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.178+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2793070930 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb015f350 0x7f3eb00bace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.178+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2793070930 >> 172.21.15.143:0/2793070930 conn(0x7f3eb0073e70 msgr2=0x7f3eb0074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.178+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2793070930 shutdown_connections 2024-05-08T10:24:22.165 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.178+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2793070930 wait complete. 2024-05-08T10:24:22.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.179+0000 7f3eb83ef640 1 Processor -- start 2024-05-08T10:24:22.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.179+0000 7f3eb83ef640 1 -- start start 2024-05-08T10:24:22.168 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb83ef640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb00b8240 0x7f3eb00cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb83ef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00d2250 0x7f3eb00cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb83ef640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eb015f350 0x7f3eb00ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb83ef640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb00d3ac0 con 0x7f3eb00d2250 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb83ef640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb00b9300 con 0x7f3eb015f350 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb83ef640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb015f730 con 0x7f3eb00b8240 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb598a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00d2250 0x7f3eb00cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb598a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00d2250 0x7f3eb00cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60440/0 (socket says 172.21.15.143:60440) 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb598a640 1 -- 172.21.15.143:0/2750560875 learned_addr learned my addr 172.21.15.143:0/2750560875 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb618b640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb00b8240 0x7f3eb00cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb698c640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eb015f350 0x7f3eb00ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb598a640 1 -- 172.21.15.143:0/2750560875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb00b8240 msgr2=0x7f3eb00cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb598a640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb00b8240 0x7f3eb00cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb598a640 1 -- 172.21.15.143:0/2750560875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eb015f350 msgr2=0x7f3eb00ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:22.169 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb598a640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eb015f350 0x7f3eb00ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb598a640 1 -- 172.21.15.143:0/2750560875 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb00cc930 con 0x7f3eb00d2250 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb698c640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eb015f350 0x7f3eb00ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.180+0000 7f3eb598a640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00d2250 0x7f3eb00cd9d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3ea002a2b0 tx=0x7f3ea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.181+0000 7f3ea6ffd640 1 -- 172.21.15.143:0/2750560875 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0037040 con 0x7f3eb00d2250 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.181+0000 7f3ea6ffd640 1 -- 172.21.15.143:0/2750560875 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea0042070 con 0x7f3eb00d2250 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.181+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb00ccc10 con 0x7f3eb00d2250 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.181+0000 7f3ea6ffd640 1 -- 172.21.15.143:0/2750560875 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0030880 con 0x7f3eb00d2250 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.181+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb00cd1d0 con 0x7f3eb00d2250 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.182+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb006a4b0 con 0x7f3eb00d2250 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.182+0000 7f3ea6ffd640 1 -- 172.21.15.143:0/2750560875 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3ea0030a20 con 0x7f3eb00d2250 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.183+0000 7f3ea6ffd640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3e94076300 0x7f3e940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.183+0000 7f3ea6ffd640 1 -- 172.21.15.143:0/2750560875 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7f3ea00b7b50 con 0x7f3eb00d2250 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.183+0000 7f3eb618b640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3e94076300 0x7f3e940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:22.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.183+0000 7f3eb618b640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3e94076300 0x7f3e940787c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009b40 tx=0x7f3eac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:22.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.187+0000 7f3ea6ffd640 1 -- 172.21.15.143:0/2750560875 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ea00817b0 con 0x7f3eb00d2250 2024-05-08T10:24:22.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:22.378+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3eb00ba800 con 0x7f3eb00d2250 2024-05-08T10:24:22.992 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.007+0000 7f3ea6ffd640 1 -- 172.21.15.143:0/2750560875 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7f3ea00810b0 con 0x7f3eb00d2250 2024-05-08T10:24:22.992 INFO:teuthology.orchestra.run.smithi143.stderr: removed all blocklist entries 2024-05-08T10:24:22.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3e94076300 msgr2=0x7f3e940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:22.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3e94076300 0x7f3e940787c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009b40 tx=0x7f3eac009190 comp rx=0 tx=0).stop 2024-05-08T10:24:22.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00d2250 msgr2=0x7f3eb00cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:22.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00d2250 0x7f3eb00cd9d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3ea002a2b0 tx=0x7f3ea00046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 shutdown_connections 2024-05-08T10:24:22.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eb015f350 0x7f3eb00ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.995 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3e94076300 0x7f3e940787c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3eb00d2250 0x7f3eb00cd9d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 --2- 172.21.15.143:0/2750560875 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3eb00b8240 0x7f3eb00cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:22.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 >> 172.21.15.143:0/2750560875 conn(0x7f3eb0073e70 msgr2=0x7f3eb006dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:22.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 shutdown_connections 2024-05-08T10:24:22.996 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.010+0000 7f3eb83ef640 1 -- 172.21.15.143:0/2750560875 wait complete. 2024-05-08T10:24:23.007 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-08T10:24:23.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.121+0000 7ff39bd58640 1 Processor -- start 2024-05-08T10:24:23.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.122+0000 7ff39bd58640 1 -- start start 2024-05-08T10:24:23.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.122+0000 7ff39bd58640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff3940d3640 0x7ff3940d4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.122+0000 7ff39bd58640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff3940d0040 0x7ff3940d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.122+0000 7ff39bd58640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3940d3b20 con 0x7ff39415f410 2024-05-08T10:24:23.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.122+0000 7ff39bd58640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff3940d3e00 con 0x7ff3940d3640 2024-05-08T10:24:23.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.122+0000 7ff39bd58640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7ff3940d40e0 con 0x7ff3940d0040 2024-05-08T10:24:23.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.123+0000 7ff3992f3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff3940d3640 0x7ff3940d4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.123+0000 7ff3992f3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff3940d3640 0x7ff3940d4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60450/0 (socket says 172.21.15.143:60450) 2024-05-08T10:24:23.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.123+0000 7ff3992f3640 1 -- 172.21.15.143:0/1782148943 learned_addr learned my addr 172.21.15.143:0/1782148943 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:23.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.123+0000 7ff39a2f5640 1 --2- 172.21.15.143:0/1782148943 >> v2:172.21.15.163:3300/0 conn(0x7ff3940d0040 0x7ff3940d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.123+0000 7ff3992f3640 1 -- 172.21.15.143:0/1782148943 >> v2:172.21.15.163:3300/0 conn(0x7ff3940d0040 msgr2=0x7ff3940d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:23.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.123+0000 7ff3992f3640 1 --2- 172.21.15.143:0/1782148943 >> v2:172.21.15.163:3300/0 conn(0x7ff3940d0040 0x7ff3940d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.123+0000 7ff3992f3640 1 -- 172.21.15.143:0/1782148943 >> v1:172.21.15.163:6789/0 conn(0x7ff39415f410 legacy=0x7ff3940bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.123+0000 7ff3992f3640 1 -- 172.21.15.143:0/1782148943 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3940d43c0 con 0x7ff3940d3640 2024-05-08T10:24:23.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff3992f3640 1 --2- 172.21.15.143:0/1782148943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d3640 0x7ff3940d4ba0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3940d1450 tx=0x7ff39002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d01e52cbb0bc4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:23.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff398af2640 1 -- 172.21.15.143:0/1782148943 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390037070 con 0x7ff3940d3640 2024-05-08T10:24:23.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff398af2640 1 -- 172.21.15.143:0/1782148943 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff390032440 con 0x7ff3940d3640 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff398af2640 1 -- 172.21.15.143:0/1782148943 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390032810 con 0x7ff3940d3640 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff39bd58640 1 -- 172.21.15.143:0/1782148943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d3640 msgr2=0x7ff3940d4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff39bd58640 1 --2- 172.21.15.143:0/1782148943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d3640 0x7ff3940d4ba0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3940d1450 tx=0x7ff39002a270 comp rx=0 tx=0).stop 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff39bd58640 1 -- 172.21.15.143:0/1782148943 shutdown_connections 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff39bd58640 1 --2- 172.21.15.143:0/1782148943 >> v2:172.21.15.163:3300/0 conn(0x7ff3940d0040 0x7ff3940d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff39bd58640 1 --2- 172.21.15.143:0/1782148943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d3640 0x7ff3940d4ba0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff39bd58640 1 -- 172.21.15.143:0/1782148943 >> 172.21.15.143:0/1782148943 conn(0x7ff394073e40 msgr2=0x7ff394074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff39bd58640 1 -- 172.21.15.143:0/1782148943 shutdown_connections 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.124+0000 7ff39bd58640 1 -- 172.21.15.143:0/1782148943 wait complete. 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff39bd58640 1 Processor -- start 2024-05-08T10:24:23.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff39bd58640 1 -- start start 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff39bd58640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d0040 0x7ff39415fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff39bd58640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3940d3640 0x7ff3940b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff39bd58640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39415f410 0x7ff39415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff39bd58640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff39415f970 con 0x7ff3940d0040 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff39bd58640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff39415f7f0 con 0x7ff39415f410 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff39bd58640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ff3940b83a0 con 0x7ff3940d3640 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff399af4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d0040 0x7ff39415fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff399af4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d0040 0x7ff39415fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:60458/0 (socket says 172.21.15.143:60458) 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.126+0000 7ff399af4640 1 -- 172.21.15.143:0/1640338766 learned_addr learned my addr 172.21.15.143:0/1640338766 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff39a2f5640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39415f410 0x7ff39415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.114 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff3992f3640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3940d3640 0x7ff3940b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff399af4640 1 -- 172.21.15.143:0/1640338766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3940d3640 msgr2=0x7ff3940b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff399af4640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3940d3640 0x7ff3940b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff399af4640 1 -- 172.21.15.143:0/1640338766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39415f410 msgr2=0x7ff39415b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff399af4640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39415f410 0x7ff39415b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff399af4640 1 -- 172.21.15.143:0/1640338766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff394160220 con 0x7ff3940d0040 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff399af4640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d0040 0x7ff39415fce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c3d0 tx=0x7ff38800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff3867fc640 1 -- 172.21.15.143:0/1640338766 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388017070 con 0x7ff3940d0040 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff3867fc640 1 -- 172.21.15.143:0/1640338766 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3880052d0 con 0x7ff3940d0040 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff3867fc640 1 -- 172.21.15.143:0/1640338766 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388003830 con 0x7ff3940d0040 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff394162d30 con 0x7ff3940d0040 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.127+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39415ad50 con 0x7ff3940d0040 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.128+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39406a4b0 con 0x7ff3940d0040 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.128+0000 7ff3867fc640 1 -- 172.21.15.143:0/1640338766 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff38801a070 con 0x7ff3940d0040 2024-05-08T10:24:23.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.129+0000 7ff3867fc640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3780762d0 0x7ff378078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.129+0000 7ff3867fc640 1 -- 172.21.15.143:0/1640338766 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ff3880965e0 con 0x7ff3940d0040 2024-05-08T10:24:23.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.129+0000 7ff3992f3640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3780762d0 0x7ff378078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.129+0000 7ff3992f3640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3780762d0 0x7ff378078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff390034000 tx=0x7ff39002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:23.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.133+0000 7ff3867fc640 1 -- 172.21.15.143:0/1640338766 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff388060290 con 0x7ff3940d0040 2024-05-08T10:24:23.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.380+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff3940ba190 con 0x7ff3940d0040 2024-05-08T10:24:23.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.380+0000 7ff3867fc640 1 -- 172.21.15.143:0/1640338766 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7ff388068280 con 0x7ff3940d0040 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: "auth_dump": [ 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.a", 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCCUjtmj/oRJBAAj+SWEE5sIjviPtkhZfAAaA==", 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.367 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.b", 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCCUjtmx7e3LxAAxDUVIwwSMbU717+Y5cn0dw==", 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.c", 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCCUjtmK/sPKxAA0RlQJoXzQU+ywnp7L+dZuA==", 2024-05-08T10:24:23.368 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mds.d", 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCCUjtmWjTHNhAAbB4Co/CoATQrtp69+Qb3XQ==", 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.369 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.0", 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCGUjtmwIVzFhAA5VMtMoa0sTgPOOrmvTFmKQ==", 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.1", 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCJUjtm13uIFRAAyy86yKW7i31iYf0PcZ1XVQ==", 2024-05-08T10:24:23.370 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.2", 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCMUjtmUjw1FBAA6TeAgklzJnOhJPcsdFfUQg==", 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.371 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.3", 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCPUjtm7utKERAAsxmGo0sHDeT2rpYzWB7sfg==", 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.372 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.4", 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCVUjtmj1xMGBAAvWd7uu1KPpXRzA1qSCT0Xg==", 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.5", 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCYUjtmQzsnFhAANCsDkfby0WAfsap11g/ZTQ==", 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.373 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.6", 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCbUjtmkLfQExAAIGWYBjWLxzjzrzzULenGpA==", 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "osd.7", 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCeUjtmhGELFBAACMPSNYoWdfRVwS/akhH6qA==", 2024-05-08T10:24:23.374 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow profile osd", 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile osd", 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.0", 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCCUjtm9n3YOhAAq9VPDZFRf917El5YIeO+8A==", 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2024-05-08T10:24:23.375 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2024-05-08T10:24:23.376 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.376 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.376 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.1", 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCDUjtmD+oMCBAAB2Gf8dQIWjpzb23VM2eiUw==", 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.2", 2024-05-08T10:24:23.377 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCDUjtmRCrOBBAAdUhEV0UVUb/Po5cOAJnvyQ==", 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.3", 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCDUjtmOoynDRAAa3AYJUsalt9qn0xrrL7GnQ==", 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.378 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow", 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow r", 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow rw", 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow rwx" 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.admin", 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCCUjtmi0yACBAA2d3jt7Fhn8uvx6DhdFMHSA==", 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "mgr": "allow *", 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow *", 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.379 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-mds", 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCkUjtmGfXTCBAAGpOuPF6J5O0IVjEqOGeHUw==", 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-mds" 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.380 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-mgr", 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCkUjtmlP/TCBAAuefLATr+3tsW1OhQpnUKeg==", 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-osd", 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCkUjtmKgbUCBAAPZtXkuweX2aOpsLm/wHPwg==", 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-osd" 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.381 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-rbd", 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCkUjtm2wzUCBAACpWY50lltK0jkgd3nsGTcA==", 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCkUjtmqBPUCBAAX9FBEUJLO5NgIlbjKch1SA==", 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.382 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "client.bootstrap-rgw", 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCkUjtmCBzUCBAA1EvNpwPNLDJ/PoJ7aMybVw==", 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.x", 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCCUjtmKQraIBAA27PzcLr3jA9+8jcK8sKkbQ==", 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.383 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: "entity": "mgr.y", 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: "key": "AQCCUjtm2ccwHRAA2cHU4vUrwcjyH3ZF/MF3tQ==", 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": { 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": "allow *", 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: "mon": "allow profile mgr", 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: "osd": "allow *" 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-05-08T10:24:23.384 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:23.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3780762d0 msgr2=0x7ff378078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3780762d0 0x7ff378078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff390034000 tx=0x7ff39002e000 comp rx=0 tx=0).stop 2024-05-08T10:24:23.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d0040 msgr2=0x7ff39415fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d0040 0x7ff39415fce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c3d0 tx=0x7ff38800c890 comp rx=0 tx=0).stop 2024-05-08T10:24:23.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 shutdown_connections 2024-05-08T10:24:23.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39415f410 0x7ff39415b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3940d3640 0x7ff3940b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3780762d0 0x7ff378078790 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 --2- 172.21.15.143:0/1640338766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3940d0040 0x7ff39415fce0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 >> 172.21.15.143:0/1640338766 conn(0x7ff394073e40 msgr2=0x7ff3940cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:23.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 shutdown_connections 2024-05-08T10:24:23.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.382+0000 7ff39bd58640 1 -- 172.21.15.143:0/1640338766 wait complete. 2024-05-08T10:24:23.387 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-08T10:24:23.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.524+0000 7fdf1f7be640 1 Processor -- start 2024-05-08T10:24:23.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.524+0000 7fdf1f7be640 1 -- start start 2024-05-08T10:24:23.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.525+0000 7fdf1f7be640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf1815f5d0 0x7fdf180d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.525+0000 7fdf1f7be640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdf180d2100 0x7fdf180d3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.525+0000 7fdf1f7be640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf180d0fc0 con 0x7fdf180d0a00 2024-05-08T10:24:23.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.525+0000 7fdf1f7be640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fdf180d3820 con 0x7fdf180d2100 2024-05-08T10:24:23.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.525+0000 7fdf1f7be640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fdf180d12a0 con 0x7fdf1815f5d0 2024-05-08T10:24:23.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.525+0000 7fdf1dd5b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdf180d2100 0x7fdf180d3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.525+0000 7fdf1d55a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf1815f5d0 0x7fdf180d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.525+0000 7fdf1cd59640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fdf180d0a00 0x7fdf180d19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:58754/0 (socket says 172.21.15.143:58754) 2024-05-08T10:24:23.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.525+0000 7fdf1cd59640 1 -- 172.21.15.143:0/43220257 learned_addr learned my addr 172.21.15.143:0/43220257 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:23.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.526+0000 7fdf1dd5b640 1 -- 172.21.15.143:0/43220257 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf1815f5d0 msgr2=0x7fdf180d5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:23.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.526+0000 7fdf1dd5b640 1 --2- 172.21.15.143:0/43220257 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf1815f5d0 0x7fdf180d5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.526+0000 7fdf1dd5b640 1 -- 172.21.15.143:0/43220257 >> v1:172.21.15.163:6789/0 conn(0x7fdf180d0a00 legacy=0x7fdf180d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.526+0000 7fdf1dd5b640 1 -- 172.21.15.143:0/43220257 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf180d31d0 con 0x7fdf180d2100 2024-05-08T10:24:23.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.526+0000 7fdf1dd5b640 1 --2- 172.21.15.143:0/43220257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf180d2100 0x7fdf180d3cb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009d90 tx=0x7fdf1002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b072afbdb3a73f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:23.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf0ffff640 1 -- 172.21.15.143:0/43220257 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10007740 con 0x7fdf180d2100 2024-05-08T10:24:23.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf0ffff640 1 -- 172.21.15.143:0/43220257 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf100078e0 con 0x7fdf180d2100 2024-05-08T10:24:23.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf0ffff640 1 -- 172.21.15.143:0/43220257 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10007cb0 con 0x7fdf180d2100 2024-05-08T10:24:23.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf1f7be640 1 -- 172.21.15.143:0/43220257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf180d2100 msgr2=0x7fdf180d3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf1f7be640 1 --2- 172.21.15.143:0/43220257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf180d2100 0x7fdf180d3cb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009d90 tx=0x7fdf1002a6f0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf1f7be640 1 -- 172.21.15.143:0/43220257 shutdown_connections 2024-05-08T10:24:23.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf1f7be640 1 --2- 172.21.15.143:0/43220257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf180d2100 0x7fdf180d3cb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf1f7be640 1 --2- 172.21.15.143:0/43220257 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf1815f5d0 0x7fdf180d5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf1f7be640 1 -- 172.21.15.143:0/43220257 >> 172.21.15.143:0/43220257 conn(0x7fdf1809e5e0 msgr2=0x7fdf180d5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:23.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf1f7be640 1 -- 172.21.15.143:0/43220257 shutdown_connections 2024-05-08T10:24:23.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.527+0000 7fdf1f7be640 1 -- 172.21.15.143:0/43220257 wait complete. 2024-05-08T10:24:23.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.528+0000 7fdf1f7be640 1 Processor -- start 2024-05-08T10:24:23.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.528+0000 7fdf1f7be640 1 -- start start 2024-05-08T10:24:23.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1f7be640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf180d0a00 0x7fdf1809f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1f7be640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf180d2100 0x7fdf180a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1f7be640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf1815f5d0 0x7fdf18152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1f7be640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1815f9b0 con 0x7fdf180d2100 2024-05-08T10:24:23.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1f7be640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdf180d6040 con 0x7fdf1815f5d0 2024-05-08T10:24:23.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1f7be640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fdf1815fb30 con 0x7fdf180d0a00 2024-05-08T10:24:23.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1cd59640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf180d2100 0x7fdf180a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1cd59640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf180d2100 0x7fdf180a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38932/0 (socket says 172.21.15.143:38932) 2024-05-08T10:24:23.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1cd59640 1 -- 172.21.15.143:0/2420705498 learned_addr learned my addr 172.21.15.143:0/2420705498 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:23.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1d55a640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf180d0a00 0x7fdf1809f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.529+0000 7fdf1dd5b640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf1815f5d0 0x7fdf18152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf1cd59640 1 -- 172.21.15.143:0/2420705498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf180d0a00 msgr2=0x7fdf1809f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf1cd59640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf180d0a00 0x7fdf1809f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf1cd59640 1 -- 172.21.15.143:0/2420705498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf1815f5d0 msgr2=0x7fdf18152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf1cd59640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf1815f5d0 0x7fdf18152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf1cd59640 1 -- 172.21.15.143:0/2420705498 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1809ffd0 con 0x7fdf180d2100 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf1cd59640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf180d2100 0x7fdf180a1e70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800c4d0 tx=0x7fdf0800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf0dffb640 1 -- 172.21.15.143:0/2420705498 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08017070 con 0x7fdf180d2100 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf0dffb640 1 -- 172.21.15.143:0/2420705498 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf08005d00 con 0x7fdf180d2100 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf180a02b0 con 0x7fdf180d2100 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf0dffb640 1 -- 172.21.15.143:0/2420705498 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf080072b0 con 0x7fdf180d2100 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.530+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf180a0870 con 0x7fdf180d2100 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.531+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf1806a550 con 0x7fdf180d2100 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.532+0000 7fdf0dffb640 1 -- 172.21.15.143:0/2420705498 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdf0801a070 con 0x7fdf180d2100 2024-05-08T10:24:23.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.532+0000 7fdf0dffb640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fdefc0762d0 0x7fdefc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.523 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.532+0000 7fdf1d55a640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fdefc0762d0 0x7fdefc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.523 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.533+0000 7fdf0dffb640 1 -- 172.21.15.143:0/2420705498 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fdf08096500 con 0x7fdf180d2100 2024-05-08T10:24:23.523 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.533+0000 7fdf1d55a640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fdefc0762d0 0x7fdefc078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009aa0 tx=0x7fdf14009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:23.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.537+0000 7fdf0dffb640 1 -- 172.21.15.143:0/2420705498 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdf0805fb60 con 0x7fdf180d2100 2024-05-08T10:24:23.770 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.785+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fdf18160980 con 0x7fdf180d2100 2024-05-08T10:24:23.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.787+0000 7fdf0dffb640 1 -- 172.21.15.143:0/2420705498 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fdf08063e60 con 0x7fdf180d2100 2024-05-08T10:24:23.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fdefc0762d0 msgr2=0x7fdefc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fdefc0762d0 0x7fdefc078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009aa0 tx=0x7fdf14009190 comp rx=0 tx=0).stop 2024-05-08T10:24:23.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf180d2100 msgr2=0x7fdf180a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf180d2100 0x7fdf180a1e70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800c4d0 tx=0x7fdf0800c990 comp rx=0 tx=0).stop 2024-05-08T10:24:23.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 shutdown_connections 2024-05-08T10:24:23.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf1815f5d0 0x7fdf18152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fdefc0762d0 0x7fdefc078790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf180d2100 0x7fdf180a1e70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 --2- 172.21.15.143:0/2420705498 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdf180d0a00 0x7fdf1809f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 >> 172.21.15.143:0/2420705498 conn(0x7fdf1809e5e0 msgr2=0x7fdf18160ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:23.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 shutdown_connections 2024-05-08T10:24:23.775 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.789+0000 7fdf1f7be640 1 -- 172.21.15.143:0/2420705498 wait complete. 2024-05-08T10:24:23.785 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-08T10:24:23.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.900+0000 7fa84f893640 1 Processor -- start 2024-05-08T10:24:23.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.900+0000 7fa84f893640 1 -- start start 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.901+0000 7fa84f893640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481607d0 0x7fa8480b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.901+0000 7fa84f893640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa8480d1270 0x7fa8480d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.901+0000 7fa84f893640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84815d580 con 0x7fa8481603f0 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.901+0000 7fa84f893640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa8480b4e70 con 0x7fa8480d1270 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.901+0000 7fa84f893640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa8480b5150 con 0x7fa8481607d0 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.901+0000 7fa84de30640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa8480d1270 0x7fa8480d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.901+0000 7fa84ce2e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481607d0 0x7fa8480b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.901+0000 7fa84d62f640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fa8481603f0 0x7fa84815ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:58758/0 (socket says 172.21.15.143:58758) 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.901+0000 7fa84d62f640 1 -- 172.21.15.143:0/3948166984 learned_addr learned my addr 172.21.15.143:0/3948166984 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.902+0000 7fa84ce2e640 1 -- 172.21.15.143:0/3948166984 >> v2:172.21.15.163:3300/0 conn(0x7fa8480d1270 msgr2=0x7fa8480d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.902+0000 7fa84ce2e640 1 --2- 172.21.15.143:0/3948166984 >> v2:172.21.15.163:3300/0 conn(0x7fa8480d1270 0x7fa8480d1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.902+0000 7fa84ce2e640 1 -- 172.21.15.143:0/3948166984 >> v1:172.21.15.163:6789/0 conn(0x7fa8481603f0 legacy=0x7fa84815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.902+0000 7fa84ce2e640 1 -- 172.21.15.143:0/3948166984 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8480b5430 con 0x7fa8481607d0 2024-05-08T10:24:23.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa84ce2e640 1 --2- 172.21.15.143:0/3948166984 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481607d0 0x7fa8480b5f10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa8380097a0 tx=0x7fa83802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c446234420555779 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:23.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa83ffff640 1 -- 172.21.15.143:0/3948166984 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838037070 con 0x7fa8481607d0 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa83ffff640 1 -- 172.21.15.143:0/3948166984 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa838032440 con 0x7fa8481607d0 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa83ffff640 1 -- 172.21.15.143:0/3948166984 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838032810 con 0x7fa8481607d0 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa84f893640 1 -- 172.21.15.143:0/3948166984 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481607d0 msgr2=0x7fa8480b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa84f893640 1 --2- 172.21.15.143:0/3948166984 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481607d0 0x7fa8480b5f10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa8380097a0 tx=0x7fa83802a180 comp rx=0 tx=0).stop 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa84f893640 1 -- 172.21.15.143:0/3948166984 shutdown_connections 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa84f893640 1 --2- 172.21.15.143:0/3948166984 >> v2:172.21.15.163:3300/0 conn(0x7fa8480d1270 0x7fa8480d1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa84f893640 1 --2- 172.21.15.143:0/3948166984 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481607d0 0x7fa8480b5f10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa84f893640 1 -- 172.21.15.143:0/3948166984 >> 172.21.15.143:0/3948166984 conn(0x7fa84806c500 msgr2=0x7fa84806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa84f893640 1 -- 172.21.15.143:0/3948166984 shutdown_connections 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.903+0000 7fa84f893640 1 -- 172.21.15.143:0/3948166984 wait complete. 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.904+0000 7fa84f893640 1 Processor -- start 2024-05-08T10:24:23.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84f893640 1 -- start start 2024-05-08T10:24:23.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84f893640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8480d1270 0x7fa84809edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84f893640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481603f0 0x7fa84806eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84f893640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8481607d0 0x7fa848167fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84f893640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa848072840 con 0x7fa8481607d0 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84f893640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa8480b59f0 con 0x7fa8480d1270 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84f893640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa8480729c0 con 0x7fa8481603f0 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84de30640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8481607d0 0x7fa848167fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84de30640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8481607d0 0x7fa848167fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38944/0 (socket says 172.21.15.143:38944) 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.905+0000 7fa84de30640 1 -- 172.21.15.143:0/1104685505 learned_addr learned my addr 172.21.15.143:0/1104685505 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84ce2e640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481603f0 0x7fa84806eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84d62f640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8480d1270 0x7fa84809edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84de30640 1 -- 172.21.15.143:0/1104685505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481603f0 msgr2=0x7fa84806eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84de30640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481603f0 0x7fa84806eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84de30640 1 -- 172.21.15.143:0/1104685505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8480d1270 msgr2=0x7fa84809edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:23.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84de30640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8480d1270 0x7fa84809edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:23.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84de30640 1 -- 172.21.15.143:0/1104685505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84815d8e0 con 0x7fa8481607d0 2024-05-08T10:24:23.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84de30640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8481607d0 0x7fa848167fa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa84000e930 tx=0x7fa84000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:23.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa83dffb640 1 -- 172.21.15.143:0/1104685505 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840017070 con 0x7fa8481607d0 2024-05-08T10:24:23.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa83dffb640 1 -- 172.21.15.143:0/1104685505 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84000c980 con 0x7fa8481607d0 2024-05-08T10:24:23.900 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84815dbc0 con 0x7fa8481607d0 2024-05-08T10:24:23.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa83dffb640 1 -- 172.21.15.143:0/1104685505 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84000cd70 con 0x7fa8481607d0 2024-05-08T10:24:23.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.906+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84815e180 con 0x7fa8481607d0 2024-05-08T10:24:23.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.907+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa848070eb0 con 0x7fa8481607d0 2024-05-08T10:24:23.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.908+0000 7fa83dffb640 1 -- 172.21.15.143:0/1104685505 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa84001a070 con 0x7fa8481607d0 2024-05-08T10:24:23.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.908+0000 7fa83dffb640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa82c0762d0 0x7fa82c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:23.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.908+0000 7fa83dffb640 1 -- 172.21.15.143:0/1104685505 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fa8400975e0 con 0x7fa8481607d0 2024-05-08T10:24:23.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.908+0000 7fa84d62f640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa82c0762d0 0x7fa82c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:23.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.909+0000 7fa84d62f640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa82c0762d0 0x7fa82c078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8440012e0 tx=0x7fa844009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:23.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:23.913+0000 7fa83dffb640 1 -- 172.21.15.143:0/1104685505 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa848070eb0 con 0x7fa8481607d0 2024-05-08T10:24:24.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.168+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fa84806a550 con 0x7fa8481607d0 2024-05-08T10:24:24.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.172+0000 7fa83dffb640 1 -- 172.21.15.143:0/1104685505 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fa8400613e0 con 0x7fa8481607d0 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa82c0762d0 msgr2=0x7fa82c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa82c0762d0 0x7fa82c078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8440012e0 tx=0x7fa844009040 comp rx=0 tx=0).stop 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8481607d0 msgr2=0x7fa848167fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8481607d0 0x7fa848167fa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa84000e930 tx=0x7fa84000edf0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 shutdown_connections 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa82c0762d0 0x7fa82c078790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8481607d0 0x7fa848167fa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8481603f0 0x7fa84806eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 --2- 172.21.15.143:0/1104685505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8480d1270 0x7fa84809edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 >> 172.21.15.143:0/1104685505 conn(0x7fa84806c500 msgr2=0x7fa8480afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:24.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 shutdown_connections 2024-05-08T10:24:24.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.175+0000 7fa84f893640 1 -- 172.21.15.143:0/1104685505 wait complete. 2024-05-08T10:24:24.171 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-08T10:24:24.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.287+0000 7f45f7571640 1 Processor -- start 2024-05-08T10:24:24.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.287+0000 7f45f7571640 1 -- start start 2024-05-08T10:24:24.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f7571640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f01603f0 0x7f45f01607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f7571640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f45f00b5f10 0x7f45f015ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f7571640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45f015d3b0 0x7f45f00d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f7571640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f45f00b6370 con 0x7f45f015d3b0 2024-05-08T10:24:24.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f7571640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f45f00b4e70 con 0x7f45f00b5f10 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f7571640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f45f00b5150 con 0x7f45f01603f0 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f5b0e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45f015d3b0 0x7f45f00d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f5b0e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45f015d3b0 0x7f45f00d1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38954/0 (socket says 172.21.15.143:38954) 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f5b0e640 1 -- 172.21.15.143:0/418023732 learned_addr learned my addr 172.21.15.143:0/418023732 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.288+0000 7f45f4b0c640 1 --2- 172.21.15.143:0/418023732 >> v2:172.21.15.163:3300/0 conn(0x7f45f00b5f10 0x7f45f015ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.289+0000 7f45f530d640 1 --2- 172.21.15.143:0/418023732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f01603f0 0x7f45f01607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.289+0000 7f45f5b0e640 1 -- 172.21.15.143:0/418023732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f01603f0 msgr2=0x7f45f01607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.289+0000 7f45f5b0e640 1 --2- 172.21.15.143:0/418023732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f01603f0 0x7f45f01607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.289+0000 7f45f5b0e640 1 -- 172.21.15.143:0/418023732 >> v2:172.21.15.163:3300/0 conn(0x7f45f00b5f10 msgr2=0x7f45f015ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.289+0000 7f45f5b0e640 1 --2- 172.21.15.143:0/418023732 >> v2:172.21.15.163:3300/0 conn(0x7f45f00b5f10 0x7f45f015ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.289+0000 7f45f5b0e640 1 -- 172.21.15.143:0/418023732 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f00b5430 con 0x7f45f015d3b0 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.289+0000 7f45f530d640 1 --2- 172.21.15.143:0/418023732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f01603f0 0x7f45f01607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.289+0000 7f45f5b0e640 1 --2- 172.21.15.143:0/418023732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f015d3b0 0x7f45f00d1270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f45f00d1e20 tx=0x7f45e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d698f01e4dbfc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.289+0000 7f45effff640 1 -- 172.21.15.143:0/418023732 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8037070 con 0x7f45f015d3b0 2024-05-08T10:24:24.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45effff640 1 -- 172.21.15.143:0/418023732 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e8032440 con 0x7f45f015d3b0 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45effff640 1 -- 172.21.15.143:0/418023732 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8032810 con 0x7f45f015d3b0 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45f7571640 1 -- 172.21.15.143:0/418023732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f015d3b0 msgr2=0x7f45f00d1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45f7571640 1 --2- 172.21.15.143:0/418023732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f015d3b0 0x7f45f00d1270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f45f00d1e20 tx=0x7f45e802a1e0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45f7571640 1 -- 172.21.15.143:0/418023732 shutdown_connections 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45f7571640 1 --2- 172.21.15.143:0/418023732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f015d3b0 0x7f45f00d1270 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45f7571640 1 --2- 172.21.15.143:0/418023732 >> v2:172.21.15.163:3300/0 conn(0x7f45f00b5f10 0x7f45f015ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45f7571640 1 --2- 172.21.15.143:0/418023732 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f01603f0 0x7f45f01607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45f7571640 1 -- 172.21.15.143:0/418023732 >> 172.21.15.143:0/418023732 conn(0x7f45f006c500 msgr2=0x7f45f006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45f7571640 1 -- 172.21.15.143:0/418023732 shutdown_connections 2024-05-08T10:24:24.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.290+0000 7f45f7571640 1 -- 172.21.15.143:0/418023732 wait complete. 2024-05-08T10:24:24.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.291+0000 7f45f7571640 1 Processor -- start 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.291+0000 7f45f7571640 1 -- start start 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f7571640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f00b5f10 0x7f45f01598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f7571640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f015d3b0 0x7f45f015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f7571640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45f01603f0 0x7f45f01f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f7571640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f45f00d17b0 con 0x7f45f00b5f10 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f7571640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f45f00b59f0 con 0x7f45f01603f0 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f7571640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f45f00d1930 con 0x7f45f015d3b0 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f530d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f00b5f10 0x7f45f01598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f530d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f00b5f10 0x7f45f01598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38956/0 (socket says 172.21.15.143:38956) 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f530d640 1 -- 172.21.15.143:0/315630716 learned_addr learned my addr 172.21.15.143:0/315630716 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f530d640 1 -- 172.21.15.143:0/315630716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f015d3b0 msgr2=0x7f45f015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f530d640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f015d3b0 0x7f45f015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f530d640 1 -- 172.21.15.143:0/315630716 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45f01603f0 msgr2=0x7f45f01f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f530d640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45f01603f0 0x7f45f01f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.292+0000 7f45f530d640 1 -- 172.21.15.143:0/315630716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f015e6e0 con 0x7f45f00b5f10 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.293+0000 7f45f530d640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f00b5f10 0x7f45f01598e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45e000cf90 tx=0x7f45e000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.293+0000 7f45edffb640 1 -- 172.21.15.143:0/315630716 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e001a070 con 0x7f45f00b5f10 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.293+0000 7f45edffb640 1 -- 172.21.15.143:0/315630716 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e000d840 con 0x7f45f00b5f10 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.293+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f015e980 con 0x7f45f00b5f10 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.293+0000 7f45edffb640 1 -- 172.21.15.143:0/315630716 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e000dc10 con 0x7f45f00b5f10 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.293+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f015ef40 con 0x7f45f00b5f10 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.294+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f006a550 con 0x7f45f00b5f10 2024-05-08T10:24:24.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.294+0000 7f45edffb640 1 -- 172.21.15.143:0/315630716 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f45e001d070 con 0x7f45f00b5f10 2024-05-08T10:24:24.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.295+0000 7f45edffb640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45dc0762d0 0x7f45dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.295+0000 7f45f4b0c640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45dc0762d0 0x7f45dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.295+0000 7f45edffb640 1 -- 172.21.15.143:0/315630716 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f45e0097940 con 0x7f45f00b5f10 2024-05-08T10:24:24.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.296+0000 7f45f4b0c640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45dc0762d0 0x7f45dc078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006fd0 tx=0x7f45e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:24.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.299+0000 7f45edffb640 1 -- 172.21.15.143:0/315630716 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f45e0061030 con 0x7f45f00b5f10 2024-05-08T10:24:24.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.548+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f45f00b4bb0 con 0x7f45f00b5f10 2024-05-08T10:24:24.537 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.552+0000 7f45edffb640 1 -- 172.21.15.143:0/315630716 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f45e0065330 con 0x7f45f00b5f10 2024-05-08T10:24:24.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45dc0762d0 msgr2=0x7f45dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45dc0762d0 0x7f45dc078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006fd0 tx=0x7f45e4008040 comp rx=0 tx=0).stop 2024-05-08T10:24:24.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f00b5f10 msgr2=0x7f45f01598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f00b5f10 0x7f45f01598e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45e000cf90 tx=0x7f45e000a7d0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 shutdown_connections 2024-05-08T10:24:24.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45f01603f0 0x7f45f01f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f015d3b0 0x7f45f015e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f45dc0762d0 0x7f45dc078790 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 --2- 172.21.15.143:0/315630716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45f00b5f10 0x7f45f01598e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 >> 172.21.15.143:0/315630716 conn(0x7f45f006c500 msgr2=0x7f45f00b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:24.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 shutdown_connections 2024-05-08T10:24:24.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.555+0000 7f45f7571640 1 -- 172.21.15.143:0/315630716 wait complete. 2024-05-08T10:24:24.551 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-08T10:24:24.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.666+0000 7f029d2da640 1 Processor -- start 2024-05-08T10:24:24.651 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.666+0000 7f029d2da640 1 -- start start 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.667+0000 7f029d2da640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f029815f600 0x7f02980d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.667+0000 7f029d2da640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02980d2830 con 0x7f02980d5a10 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.667+0000 7f029d2da640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02980d3070 con 0x7f02980d0e20 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.667+0000 7f029d2da640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f02980d3350 con 0x7f029815f600 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.667+0000 7f02967fc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f02980d5a10 0x7f02980b1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32962/0 (socket says 172.21.15.143:32962) 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.667+0000 7f02967fc640 1 -- 172.21.15.143:0/2869025825 learned_addr learned my addr 172.21.15.143:0/2869025825 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.667+0000 7f0296ffd640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f029815f600 0x7f02980d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.667+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081450584 0 0) 0x7f02980d2830 con 0x7f02980d5a10 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.667+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0280003520 con 0x7f02980d5a10 2024-05-08T10:24:24.655 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 738519643 0 0) 0x7f0280003520 con 0x7f02980d5a10 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f029815f600 msgr2=0x7f02980d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f029815f600 0x7f02980d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 >> v1:172.21.15.163:6789/0 conn(0x7f02980d0e20 legacy=0x7f02980b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02980d3630 con 0x7f02980d5a10 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f028c0016f0 con 0x7f02980d5a10 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 >> v1:172.21.15.143:6789/0 conn(0x7f02980d5a10 legacy=0x7f02980b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0280003a30 0x7f0280003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f029815f600 0x7f0280004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0280004d40 0x7f02800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f02980d3350 con 0x7f0280003a30 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f028000bb80 con 0x7f0280004d40 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f028000bd80 con 0x7f029815f600 2024-05-08T10:24:24.656 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0296ffd640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0280003a30 0x7f0280003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f02977fe640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0280004d40 0x7f02800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f02967fc640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f029815f600 0x7f0280004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0296ffd640 1 -- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f029815f600 msgr2=0x7f0280004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0296ffd640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f029815f600 0x7f0280004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0296ffd640 1 -- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0280004d40 msgr2=0x7f02800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0296ffd640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0280004d40 0x7f02800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f0296ffd640 1 -- 172.21.15.143:0/2869025825 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0280003520 con 0x7f0280003a30 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.668+0000 7f02967fc640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f029815f600 0x7f0280004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f0296ffd640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0280003a30 0x7f0280003e50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0288009fc0 tx=0x7f0280005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2499745d1e6b7a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288009c10 con 0x7f0280003a30 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0288036070 con 0x7f0280003a30 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f0295ffb640 1 -- 172.21.15.143:0/2869025825 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288031880 con 0x7f0280003a30 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f029d2da640 1 -- 172.21.15.143:0/2869025825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0280003a30 msgr2=0x7f0280003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.657 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f029d2da640 1 --2- 172.21.15.143:0/2869025825 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0280003a30 0x7f0280003e50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0288009fc0 tx=0x7f0280005830 comp rx=0 tx=0).stop 2024-05-08T10:24:24.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f02977fe640 1 -- 172.21.15.143:0/2869025825 reap_dead start 2024-05-08T10:24:24.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f029d2da640 1 -- 172.21.15.143:0/2869025825 shutdown_connections 2024-05-08T10:24:24.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f029d2da640 1 -- 172.21.15.143:0/2869025825 >> 172.21.15.143:0/2869025825 conn(0x7f029809e5b0 msgr2=0x7f02980d5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:24.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.669+0000 7f029d2da640 1 -- 172.21.15.143:0/2869025825 shutdown_connections 2024-05-08T10:24:24.658 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.670+0000 7f029d2da640 1 -- 172.21.15.143:0/2869025825 wait complete. 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.671+0000 7f029d2da640 1 Processor -- start 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.671+0000 7f029d2da640 1 -- start start 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f029d2da640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0280003a30 0x7f02981626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f029d2da640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f029815fca0 0x7f0298155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f029d2da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02980c8df0 0x7f02980b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f029d2da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f02980d4160 con 0x7f02980c8df0 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f029d2da640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f02980d3c40 con 0x7f029815fca0 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f029d2da640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f029815f9e0 con 0x7f0280003a30 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02977fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02980c8df0 0x7f02980b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02977fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02980c8df0 0x7f02980b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38972/0 (socket says 172.21.15.143:38972) 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02977fe640 1 -- 172.21.15.143:0/1110811951 learned_addr learned my addr 172.21.15.143:0/1110811951 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02967fc640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f029815fca0 0x7f0298155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f0296ffd640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0280003a30 0x7f02981626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02977fe640 1 -- 172.21.15.143:0/1110811951 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0280003a30 msgr2=0x7f02981626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02977fe640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0280003a30 0x7f02981626e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02977fe640 1 -- 172.21.15.143:0/1110811951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f029815fca0 msgr2=0x7f0298155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02977fe640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f029815fca0 0x7f0298155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02977fe640 1 -- 172.21.15.143:0/1110811951 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02980b5c30 con 0x7f02980c8df0 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f0296ffd640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0280003a30 0x7f02981626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f02977fe640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02980c8df0 0x7f02980b69f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f02980d2e80 tx=0x7f029000f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f027f7fe640 1 -- 172.21.15.143:0/1110811951 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290019070 con 0x7f02980c8df0 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f027f7fe640 1 -- 172.21.15.143:0/1110811951 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02900050d0 con 0x7f02980c8df0 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f027f7fe640 1 -- 172.21.15.143:0/1110811951 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290006aa0 con 0x7f02980c8df0 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02980b5f10 con 0x7f02980c8df0 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.672+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02980b64d0 con 0x7f02980c8df0 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.673+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02980b66d0 con 0x7f02980c8df0 2024-05-08T10:24:24.662 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.674+0000 7f027f7fe640 1 -- 172.21.15.143:0/1110811951 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f029001c070 con 0x7f02980c8df0 2024-05-08T10:24:24.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.674+0000 7f027f7fe640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f02840762d0 0x7f0284078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:24.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.674+0000 7f0296ffd640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f02840762d0 0x7f0284078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:24.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.674+0000 7f027f7fe640 1 -- 172.21.15.143:0/1110811951 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f0290096150 con 0x7f02980c8df0 2024-05-08T10:24:24.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.675+0000 7f0296ffd640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f02840762d0 0x7f0284078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0288035000 tx=0x7f028802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:24.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.679+0000 7f027f7fe640 1 -- 172.21.15.143:0/1110811951 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f02980b66d0 con 0x7f02980c8df0 2024-05-08T10:24:24.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.928+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f029806a550 con 0x7f02980c8df0 2024-05-08T10:24:24.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.932+0000 7f027f7fe640 1 -- 172.21.15.143:0/1110811951 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f029005f840 con 0x7f02980c8df0 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f02840762d0 msgr2=0x7f0284078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f02840762d0 0x7f0284078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0288035000 tx=0x7f028802f000 comp rx=0 tx=0).stop 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02980c8df0 msgr2=0x7f02980b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02980c8df0 0x7f02980b69f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f02980d2e80 tx=0x7f029000f890 comp rx=0 tx=0).stop 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 shutdown_connections 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f02840762d0 0x7f0284078790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02980c8df0 0x7f02980b69f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f029815fca0 0x7f0298155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 --2- 172.21.15.143:0/1110811951 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0280003a30 0x7f02981626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 >> 172.21.15.143:0/1110811951 conn(0x7f029809e5b0 msgr2=0x7f02980b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 shutdown_connections 2024-05-08T10:24:24.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:24.934+0000 7f029d2da640 1 -- 172.21.15.143:0/1110811951 wait complete. 2024-05-08T10:24:24.931 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-08T10:24:25.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.048+0000 7fae9f2c4640 1 Processor -- start 2024-05-08T10:24:25.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.049+0000 7fae9f2c4640 1 -- start start 2024-05-08T10:24:25.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.049+0000 7fae9f2c4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fae980d36b0 0x7fae980b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.049+0000 7fae9f2c4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fae980b68f0 0x7fae9806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.049+0000 7fae9f2c4640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae98162fd0 con 0x7fae98148d90 2024-05-08T10:24:25.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.049+0000 7fae9f2c4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fae980b7070 con 0x7fae980b68f0 2024-05-08T10:24:25.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.049+0000 7fae9f2c4640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fae981632b0 con 0x7fae980d36b0 2024-05-08T10:24:25.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.050+0000 7fae9d861640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fae980b68f0 0x7fae9806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.050+0000 7fae9d861640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fae980b68f0 0x7fae9806d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38978/0 (socket says 172.21.15.143:38978) 2024-05-08T10:24:25.035 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.050+0000 7fae9d861640 1 -- 172.21.15.143:0/2777486168 learned_addr learned my addr 172.21.15.143:0/2777486168 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:25.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.050+0000 7fae9c85f640 1 --2- 172.21.15.143:0/2777486168 >> v2:172.21.15.163:3300/0 conn(0x7fae980d36b0 0x7fae980b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.050+0000 7fae9d861640 1 -- 172.21.15.143:0/2777486168 >> v2:172.21.15.163:3300/0 conn(0x7fae980d36b0 msgr2=0x7fae980b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:25.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.050+0000 7fae9d861640 1 --2- 172.21.15.143:0/2777486168 >> v2:172.21.15.163:3300/0 conn(0x7fae980d36b0 0x7fae980b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.050+0000 7fae9d861640 1 -- 172.21.15.143:0/2777486168 >> v1:172.21.15.163:6789/0 conn(0x7fae98148d90 legacy=0x7fae980d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:25.036 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.050+0000 7fae9d861640 1 -- 172.21.15.143:0/2777486168 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae98163590 con 0x7fae980b68f0 2024-05-08T10:24:25.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae9d861640 1 --2- 172.21.15.143:0/2777486168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980b68f0 0x7fae9806d900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fae98073130 tx=0x7fae9002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e729d97cbc6752bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:25.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae8ffff640 1 -- 172.21.15.143:0/2777486168 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90036070 con 0x7fae980b68f0 2024-05-08T10:24:25.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae8ffff640 1 -- 172.21.15.143:0/2777486168 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae90031400 con 0x7fae980b68f0 2024-05-08T10:24:25.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae8ffff640 1 -- 172.21.15.143:0/2777486168 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae900317d0 con 0x7fae980b68f0 2024-05-08T10:24:25.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae9f2c4640 1 -- 172.21.15.143:0/2777486168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980b68f0 msgr2=0x7fae9806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae9f2c4640 1 --2- 172.21.15.143:0/2777486168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980b68f0 0x7fae9806d900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fae98073130 tx=0x7fae9002a5d0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae9f2c4640 1 -- 172.21.15.143:0/2777486168 shutdown_connections 2024-05-08T10:24:25.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae9f2c4640 1 --2- 172.21.15.143:0/2777486168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980b68f0 0x7fae9806d900 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae9f2c4640 1 --2- 172.21.15.143:0/2777486168 >> v2:172.21.15.163:3300/0 conn(0x7fae980d36b0 0x7fae980b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae9f2c4640 1 -- 172.21.15.143:0/2777486168 >> 172.21.15.143:0/2777486168 conn(0x7fae980b4da0 msgr2=0x7fae980b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:25.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae9f2c4640 1 -- 172.21.15.143:0/2777486168 shutdown_connections 2024-05-08T10:24:25.038 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.051+0000 7fae9f2c4640 1 -- 172.21.15.143:0/2777486168 wait complete. 2024-05-08T10:24:25.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.052+0000 7fae9f2c4640 1 Processor -- start 2024-05-08T10:24:25.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9f2c4640 1 -- start start 2024-05-08T10:24:25.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9f2c4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae980b68f0 0x7fae98141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9f2c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980d36b0 0x7fae9813e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9f2c4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fae98148d90 0x7fae9813edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9f2c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fae980b6d00 con 0x7fae980d36b0 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9f2c4640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fae98163d90 con 0x7fae980b68f0 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9f2c4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fae9806de40 con 0x7fae98148d90 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9c85f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980d36b0 0x7fae9813e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9c85f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980d36b0 0x7fae9813e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:38992/0 (socket says 172.21.15.143:38992) 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.053+0000 7fae9c85f640 1 -- 172.21.15.143:0/1234053485 learned_addr learned my addr 172.21.15.143:0/1234053485 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9d861640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fae98148d90 0x7fae9813edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9d060640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae980b68f0 0x7fae98141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9c85f640 1 -- 172.21.15.143:0/1234053485 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fae98148d90 msgr2=0x7fae9813edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9c85f640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fae98148d90 0x7fae9813edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9c85f640 1 -- 172.21.15.143:0/1234053485 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae980b68f0 msgr2=0x7fae98141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9c85f640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae980b68f0 0x7fae98141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9c85f640 1 -- 172.21.15.143:0/1234053485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9815ef00 con 0x7fae980d36b0 2024-05-08T10:24:25.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9c85f640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980d36b0 0x7fae9813e870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae8800d800 tx=0x7fae8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:25.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae8dffb640 1 -- 172.21.15.143:0/1234053485 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8800b6c0 con 0x7fae980d36b0 2024-05-08T10:24:25.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae8dffb640 1 -- 172.21.15.143:0/1234053485 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae88019070 con 0x7fae980d36b0 2024-05-08T10:24:25.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae98140ea0 con 0x7fae980d36b0 2024-05-08T10:24:25.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae8dffb640 1 -- 172.21.15.143:0/1234053485 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8800ba80 con 0x7fae980d36b0 2024-05-08T10:24:25.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.054+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae98141460 con 0x7fae980d36b0 2024-05-08T10:24:25.042 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.055+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae98075dc0 con 0x7fae980d36b0 2024-05-08T10:24:25.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.056+0000 7fae8dffb640 1 -- 172.21.15.143:0/1234053485 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae8800bc20 con 0x7fae980d36b0 2024-05-08T10:24:25.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.056+0000 7fae8dffb640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fae7c0762d0 0x7fae7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.057+0000 7fae9d060640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fae7c0762d0 0x7fae7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.057+0000 7fae8dffb640 1 -- 172.21.15.143:0/1234053485 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fae880977b0 con 0x7fae980d36b0 2024-05-08T10:24:25.043 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.057+0000 7fae9d060640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fae7c0762d0 0x7fae7c078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fae94006fd0 tx=0x7fae94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:25.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.061+0000 7fae8dffb640 1 -- 172.21.15.143:0/1234053485 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fae88061460 con 0x7fae980d36b0 2024-05-08T10:24:25.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.310+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fae9806edd0 con 0x7fae980d36b0 2024-05-08T10:24:25.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.314+0000 7fae8dffb640 1 -- 172.21.15.143:0/1234053485 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7fae88060d60 con 0x7fae980d36b0 2024-05-08T10:24:25.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fae7c0762d0 msgr2=0x7fae7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fae7c0762d0 0x7fae7c078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fae94006fd0 tx=0x7fae94008040 comp rx=0 tx=0).stop 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980d36b0 msgr2=0x7fae9813e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980d36b0 0x7fae9813e870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fae8800d800 tx=0x7fae8800dcc0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 shutdown_connections 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fae98148d90 0x7fae9813edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fae7c0762d0 0x7fae7c078790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae980d36b0 0x7fae9813e870 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 --2- 172.21.15.143:0/1234053485 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae980b68f0 0x7fae98141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 >> 172.21.15.143:0/1234053485 conn(0x7fae980b4da0 msgr2=0x7fae980b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 shutdown_connections 2024-05-08T10:24:25.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.316+0000 7fae9f2c4640 1 -- 172.21.15.143:0/1234053485 wait complete. 2024-05-08T10:24:25.313 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-08T10:24:25.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.428+0000 7fa5f2514640 1 Processor -- start 2024-05-08T10:24:25.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.428+0000 7fa5f2514640 1 -- start start 2024-05-08T10:24:25.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5f2514640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec1607d0 0x7fa5ec0b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5f2514640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5ec15d580 con 0x7fa5ec0d1270 2024-05-08T10:24:25.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5f2514640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5ec0b4e70 con 0x7fa5ec1603f0 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5f2514640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ec0b5150 con 0x7fa5ec1607d0 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5f0ab1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa5ec0d1270 0x7fa5ec072840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32966/0 (socket says 172.21.15.143:32966) 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5f0ab1640 1 -- 172.21.15.143:0/2391397616 learned_addr learned my addr 172.21.15.143:0/2391397616 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334544470 0 0) 0x7fa5ec15d580 con 0x7fa5ec0d1270 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eb7fe640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec1607d0 0x7fa5ec0b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5d4005730 con 0x7fa5ec0d1270 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1031697107 0 0) 0x7fa5d4005730 con 0x7fa5ec0d1270 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec1607d0 msgr2=0x7fa5ec0b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec1607d0 0x7fa5ec0b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 >> v1:172.21.15.163:6789/0 conn(0x7fa5ec1603f0 legacy=0x7fa5ec15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec0b5430 con 0x7fa5ec0d1270 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7fa5e4001a70 con 0x7fa5ec0d1270 2024-05-08T10:24:25.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 >> v1:172.21.15.143:6789/0 conn(0x7fa5ec0d1270 legacy=0x7fa5ec072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec1607d0 0x7fa5d4005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5d4006180 0x7fa5d4006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5d4006f50 0x7fa5d40073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec0b5150 con 0x7fa5d4006f50 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d400dce0 con 0x7fa5d4006180 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.429+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d400dee0 con 0x7fa5ec1607d0 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.430+0000 7fa5f0ab1640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5d4006f50 0x7fa5d40073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.430+0000 7fa5eb7fe640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5d4006180 0x7fa5d4006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.430+0000 7fa5ebfff640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec1607d0 0x7fa5d4005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.430+0000 7fa5f0ab1640 1 -- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec1607d0 msgr2=0x7fa5d4005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.430+0000 7fa5f0ab1640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec1607d0 0x7fa5d4005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.430+0000 7fa5f0ab1640 1 -- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5d4006180 msgr2=0x7fa5d4006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.430+0000 7fa5f0ab1640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5d4006180 0x7fa5d4006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.430+0000 7fa5f0ab1640 1 -- 172.21.15.143:0/2391397616 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d4005730 con 0x7fa5d4006f50 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5f0ab1640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5d4006f50 0x7fa5d40073d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4002230 tx=0x7fa5d4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5726be5e849ec2cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400a410 con 0x7fa5d4006f50 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e402f070 con 0x7fa5d4006f50 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5eaffd640 1 -- 172.21.15.143:0/2391397616 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e402bb50 con 0x7fa5d4006f50 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5f2514640 1 -- 172.21.15.143:0/2391397616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5d4006f50 msgr2=0x7fa5d40073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5f2514640 1 --2- 172.21.15.143:0/2391397616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5d4006f50 0x7fa5d40073d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4002230 tx=0x7fa5d4007a40 comp rx=0 tx=0).stop 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5f0ab1640 1 -- 172.21.15.143:0/2391397616 reap_dead start 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5f2514640 1 -- 172.21.15.143:0/2391397616 shutdown_connections 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5f2514640 1 -- 172.21.15.143:0/2391397616 >> 172.21.15.143:0/2391397616 conn(0x7fa5ec06c500 msgr2=0x7fa5ec06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5f2514640 1 -- 172.21.15.143:0/2391397616 shutdown_connections 2024-05-08T10:24:25.420 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.431+0000 7fa5f2514640 1 -- 172.21.15.143:0/2391397616 wait complete. 2024-05-08T10:24:25.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.432+0000 7fa5f2514640 1 Processor -- start 2024-05-08T10:24:25.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5f2514640 1 -- start start 2024-05-08T10:24:25.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5f2514640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec14a010 0x7fa5ec14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5f2514640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5ec06e4b0 0x7fa5ec15e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5f2514640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5ec0aea40 0x7fa5ec15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.423 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5f2514640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec0b5f10 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5f2514640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec0b59f0 con 0x7fa5ec0aea40 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5f2514640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ec0b6090 con 0x7fa5ec14a010 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5ec06e4b0 0x7fa5ec15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5ec06e4b0 0x7fa5ec15e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39010/0 (socket says 172.21.15.143:39010) 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.433+0000 7fa5eb7fe640 1 -- 172.21.15.143:0/3437009818 learned_addr learned my addr 172.21.15.143:0/3437009818 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5ebfff640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec14a010 0x7fa5ec14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5f0ab1640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5ec0aea40 0x7fa5ec15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5eb7fe640 1 -- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec14a010 msgr2=0x7fa5ec14a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5eb7fe640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec14a010 0x7fa5ec14a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5eb7fe640 1 -- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5ec0aea40 msgr2=0x7fa5ec15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5eb7fe640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5ec0aea40 0x7fa5ec15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5eb7fe640 1 -- 172.21.15.143:0/3437009818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec0aef90 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.424 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5ebfff640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec14a010 0x7fa5ec14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5f0ab1640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5ec0aea40 0x7fa5ec15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5eb7fe640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5ec06e4b0 0x7fa5ec15e800 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00119a0 tx=0x7fa5e0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5e8ff9640 1 -- 172.21.15.143:0/3437009818 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000faf0 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5e8ff9640 1 -- 172.21.15.143:0/3437009818 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e000fc90 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ec0af270 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5e8ff9640 1 -- 172.21.15.143:0/3437009818 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0014440 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.434+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ec0af830 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.435+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5ec06a550 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.436+0000 7fa5e8ff9640 1 -- 172.21.15.143:0/3437009818 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa5e0012040 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.436+0000 7fa5e8ff9640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5d8076300 0x7fa5d80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.436+0000 7fa5e8ff9640 1 -- 172.21.15.143:0/3437009818 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fa5e00978d0 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.436+0000 7fa5ebfff640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5d8076300 0x7fa5d80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.425 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.437+0000 7fa5ebfff640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5d8076300 0x7fa5d80787c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc003700 tx=0x7fa5dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:25.426 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.441+0000 7fa5e8ff9640 1 -- 172.21.15.143:0/3437009818 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa5e0019030 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.689+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fa5ec0b4bb0 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.694+0000 7fa5e8ff9640 1 -- 172.21.15.143:0/3437009818 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fa5e0061580 con 0x7fa5ec06e4b0 2024-05-08T10:24:25.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5d8076300 msgr2=0x7fa5d80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5d8076300 0x7fa5d80787c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc003700 tx=0x7fa5dc009040 comp rx=0 tx=0).stop 2024-05-08T10:24:25.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5ec06e4b0 msgr2=0x7fa5ec15e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5ec06e4b0 0x7fa5ec15e800 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00119a0 tx=0x7fa5e0011e60 comp rx=0 tx=0).stop 2024-05-08T10:24:25.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 shutdown_connections 2024-05-08T10:24:25.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5ec0aea40 0x7fa5ec15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa5d8076300 0x7fa5d80787c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5ec06e4b0 0x7fa5ec15e800 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 --2- 172.21.15.143:0/3437009818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa5ec14a010 0x7fa5ec14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 >> 172.21.15.143:0/3437009818 conn(0x7fa5ec06c500 msgr2=0x7fa5ec06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:25.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 shutdown_connections 2024-05-08T10:24:25.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.696+0000 7fa5f2514640 1 -- 172.21.15.143:0/3437009818 wait complete. 2024-05-08T10:24:25.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T10:24:25.793 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.807+0000 7f8fd339e640 1 Processor -- start 2024-05-08T10:24:25.794 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.807+0000 7f8fd339e640 1 -- start start 2024-05-08T10:24:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd339e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc0703b0 0x7f8fcc15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd339e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8fcc160360 0x7f8fcc0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd339e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fcc070920 con 0x7f8fcc1563f0 2024-05-08T10:24:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd339e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8fcc0b4af0 con 0x7f8fcc160360 2024-05-08T10:24:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd339e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc070ee0 con 0x7f8fcc0703b0 2024-05-08T10:24:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd239c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8fcc1563f0 0x7f8fcc15f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32982/0 (socket says 172.21.15.143:32982) 2024-05-08T10:24:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd2b9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8fcc160360 0x7f8fcc0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd239c640 1 -- 172.21.15.143:0/1604274120 learned_addr learned my addr 172.21.15.143:0/1604274120 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:25.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd2b9d640 1 -- 172.21.15.143:0/1604274120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc0703b0 msgr2=0x7f8fcc15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:25.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.808+0000 7f8fd1b9b640 1 --2- 172.21.15.143:0/1604274120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc0703b0 0x7f8fcc15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.809+0000 7f8fd139a640 1 -- 172.21.15.143:0/1604274120 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352210748 0 0) 0x7f8fcc070920 con 0x7f8fcc1563f0 2024-05-08T10:24:25.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.809+0000 7f8fd2b9d640 1 --2- 172.21.15.143:0/1604274120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc0703b0 0x7f8fcc15fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.809+0000 7f8fd2b9d640 1 -- 172.21.15.143:0/1604274120 >> v1:172.21.15.143:6789/0 conn(0x7f8fcc1563f0 legacy=0x7f8fcc15f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.809+0000 7f8fd2b9d640 1 -- 172.21.15.143:0/1604274120 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc070c00 con 0x7f8fcc160360 2024-05-08T10:24:25.796 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.809+0000 7f8fd2b9d640 1 --2- 172.21.15.143:0/1604274120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 0x7f8fcc0b4f80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40097a0 tx=0x7f8fc402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfeada42a7a1fe4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:25.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.809+0000 7f8fd139a640 1 -- 172.21.15.143:0/1604274120 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4037070 con 0x7f8fcc160360 2024-05-08T10:24:25.797 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.809+0000 7f8fd139a640 1 -- 172.21.15.143:0/1604274120 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc402ae50 con 0x7f8fcc160360 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.809+0000 7f8fd139a640 1 -- 172.21.15.143:0/1604274120 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4032660 con 0x7f8fcc160360 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.810+0000 7f8fd339e640 1 -- 172.21.15.143:0/1604274120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 msgr2=0x7f8fcc0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.810+0000 7f8fd339e640 1 --2- 172.21.15.143:0/1604274120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 0x7f8fcc0b4f80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40097a0 tx=0x7f8fc402a100 comp rx=0 tx=0).stop 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.810+0000 7f8fd339e640 1 -- 172.21.15.143:0/1604274120 shutdown_connections 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.810+0000 7f8fd339e640 1 --2- 172.21.15.143:0/1604274120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 0x7f8fcc0b4f80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.810+0000 7f8fd339e640 1 --2- 172.21.15.143:0/1604274120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc0703b0 0x7f8fcc15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.810+0000 7f8fd339e640 1 -- 172.21.15.143:0/1604274120 >> 172.21.15.143:0/1604274120 conn(0x7f8fcc0738e0 msgr2=0x7f8fcc06c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.810+0000 7f8fd339e640 1 -- 172.21.15.143:0/1604274120 shutdown_connections 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.810+0000 7f8fd339e640 1 -- 172.21.15.143:0/1604274120 wait complete. 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.811+0000 7f8fd339e640 1 Processor -- start 2024-05-08T10:24:25.798 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.811+0000 7f8fd339e640 1 -- start start 2024-05-08T10:24:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd339e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8fcc0703b0 0x7f8fcc1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd339e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc1563f0 0x7f8fcc13cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd339e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 0x7f8fcc155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd339e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc0b54c0 con 0x7f8fcc160360 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd339e640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc0b6a20 con 0x7f8fcc0703b0 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd339e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc0b5640 con 0x7f8fcc1563f0 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd2b9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 0x7f8fcc155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd2b9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 0x7f8fcc155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39020/0 (socket says 172.21.15.143:39020) 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd2b9d640 1 -- 172.21.15.143:0/1929952963 learned_addr learned my addr 172.21.15.143:0/1929952963 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd239c640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8fcc0703b0 0x7f8fcc1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.812+0000 7f8fd1b9b640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc1563f0 0x7f8fcc13cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fd2b9d640 1 -- 172.21.15.143:0/1929952963 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc1563f0 msgr2=0x7f8fcc13cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fd2b9d640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc1563f0 0x7f8fcc13cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fd2b9d640 1 -- 172.21.15.143:0/1929952963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8fcc0703b0 msgr2=0x7f8fcc1533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fd2b9d640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8fcc0703b0 0x7f8fcc1533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fd2b9d640 1 -- 172.21.15.143:0/1929952963 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc13d790 con 0x7f8fcc160360 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fd1b9b640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc1563f0 0x7f8fcc13cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fd2b9d640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 0x7f8fcc155420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40097a0 tx=0x7f8fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fc2ffd640 1 -- 172.21.15.143:0/1929952963 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4042070 con 0x7f8fcc160360 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fc2ffd640 1 -- 172.21.15.143:0/1929952963 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc4032e10 con 0x7f8fcc160360 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc13da00 con 0x7f8fcc160360 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fc2ffd640 1 -- 172.21.15.143:0/1929952963 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4037040 con 0x7f8fcc160360 2024-05-08T10:24:25.802 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.813+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc13dfc0 con 0x7f8fcc160360 2024-05-08T10:24:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.814+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fcc06a3d0 con 0x7f8fcc160360 2024-05-08T10:24:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.815+0000 7f8fc2ffd640 1 -- 172.21.15.143:0/1929952963 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8fc4045070 con 0x7f8fcc160360 2024-05-08T10:24:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.815+0000 7f8fc2ffd640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8fb00762d0 0x7f8fb0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.815+0000 7f8fd239c640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8fb00762d0 0x7f8fb0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.815+0000 7f8fc2ffd640 1 -- 172.21.15.143:0/1929952963 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f8fc40b79d0 con 0x7f8fcc160360 2024-05-08T10:24:25.803 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.816+0000 7f8fd239c640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8fb00762d0 0x7f8fb0078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80012e0 tx=0x7f8fc80016f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:25.805 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:25.819+0000 7f8fc2ffd640 1 -- 172.21.15.143:0/1929952963 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8fc4081030 con 0x7f8fcc160360 2024-05-08T10:24:25.990 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.004+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8fcc1520b0 con 0x7f8fcc160360 2024-05-08T10:24:25.991 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.005+0000 7f8fc2ffd640 1 -- 172.21.15.143:0/1929952963 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7f8fc4085330 con 0x7f8fcc160360 2024-05-08T10:24:25.991 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:25.991 INFO:teuthology.orchestra.run.smithi143.stdout:[ 2024-05-08T10:24:25.991 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:25.991 INFO:teuthology.orchestra.run.smithi143.stdout: "poolnum": 1, 2024-05-08T10:24:25.991 INFO:teuthology.orchestra.run.smithi143.stdout: "poolname": ".mgr" 2024-05-08T10:24:25.991 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:25.991 INFO:teuthology.orchestra.run.smithi143.stdout:] 2024-05-08T10:24:25.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8fb00762d0 msgr2=0x7f8fb0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8fb00762d0 0x7f8fb0078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80012e0 tx=0x7f8fc80016f0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 msgr2=0x7f8fcc155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:25.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 0x7f8fcc155420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40097a0 tx=0x7f8fc40046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.993 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 shutdown_connections 2024-05-08T10:24:25.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8fb00762d0 0x7f8fb0078790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fcc160360 0x7f8fcc155420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8fcc1563f0 0x7f8fcc13cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 --2- 172.21.15.143:0/1929952963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8fcc0703b0 0x7f8fcc1533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:25.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 >> 172.21.15.143:0/1929952963 conn(0x7f8fcc0738e0 msgr2=0x7f8fcc06d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:25.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 shutdown_connections 2024-05-08T10:24:25.994 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.007+0000 7f8fd339e640 1 -- 172.21.15.143:0/1929952963 wait complete. 2024-05-08T10:24:26.004 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T10:24:26.004 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T10:24:26.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.122+0000 7fa8c8d19640 1 Processor -- start 2024-05-08T10:24:26.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.122+0000 7fa8c8d19640 1 -- start start 2024-05-08T10:24:26.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c8d19640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa8c4070e50 0x7fa8c4071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:26.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c8d19640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa8c40cf5a0 0x7fa8c406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c8d19640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c40b7b20 con 0x7fa8c40d3b60 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c8d19640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c40b82b0 con 0x7fa8c40cf5a0 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c8d19640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c4070900 con 0x7fa8c4070e50 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c2d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa8c40cf5a0 0x7fa8c406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c2d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa8c40cf5a0 0x7fa8c406e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39024/0 (socket says 172.21.15.143:39024) 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c2d9d640 1 -- 172.21.15.143:0/1860917242 learned_addr learned my addr 172.21.15.143:0/1860917242 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c259c640 1 --2- 172.21.15.143:0/1860917242 >> v2:172.21.15.163:3300/0 conn(0x7fa8c4070e50 0x7fa8c4071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c2d9d640 1 -- 172.21.15.143:0/1860917242 >> v2:172.21.15.163:3300/0 conn(0x7fa8c4070e50 msgr2=0x7fa8c4071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c2d9d640 1 --2- 172.21.15.143:0/1860917242 >> v2:172.21.15.163:3300/0 conn(0x7fa8c4070e50 0x7fa8c4071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c2d9d640 1 -- 172.21.15.143:0/1860917242 >> v1:172.21.15.163:6789/0 conn(0x7fa8c40d3b60 legacy=0x7fa8c406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:26.110 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.123+0000 7fa8c2d9d640 1 -- 172.21.15.143:0/1860917242 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c40aff30 con 0x7fa8c40cf5a0 2024-05-08T10:24:26.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.124+0000 7fa8c2d9d640 1 --2- 172.21.15.143:0/1860917242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40cf5a0 0x7fa8c406e550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4073120 tx=0x7fa8bc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68484dd2a4bae98f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:26.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.124+0000 7fa8c159a640 1 -- 172.21.15.143:0/1860917242 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc036070 con 0x7fa8c40cf5a0 2024-05-08T10:24:26.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.124+0000 7fa8c159a640 1 -- 172.21.15.143:0/1860917242 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8bc031600 con 0x7fa8c40cf5a0 2024-05-08T10:24:26.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.124+0000 7fa8c159a640 1 -- 172.21.15.143:0/1860917242 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0319d0 con 0x7fa8c40cf5a0 2024-05-08T10:24:26.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.125+0000 7fa8c8d19640 1 -- 172.21.15.143:0/1860917242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40cf5a0 msgr2=0x7fa8c406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:26.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.125+0000 7fa8c8d19640 1 --2- 172.21.15.143:0/1860917242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40cf5a0 0x7fa8c406e550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4073120 tx=0x7fa8bc02a6a0 comp rx=0 tx=0).stop 2024-05-08T10:24:26.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.125+0000 7fa8c8d19640 1 -- 172.21.15.143:0/1860917242 shutdown_connections 2024-05-08T10:24:26.112 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.125+0000 7fa8c8d19640 1 --2- 172.21.15.143:0/1860917242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40cf5a0 0x7fa8c406e550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:26.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.125+0000 7fa8c8d19640 1 --2- 172.21.15.143:0/1860917242 >> v2:172.21.15.163:3300/0 conn(0x7fa8c4070e50 0x7fa8c4071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:26.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.125+0000 7fa8c8d19640 1 -- 172.21.15.143:0/1860917242 >> 172.21.15.143:0/1860917242 conn(0x7fa8c40d3040 msgr2=0x7fa8c40d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:26.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.125+0000 7fa8c8d19640 1 -- 172.21.15.143:0/1860917242 shutdown_connections 2024-05-08T10:24:26.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.125+0000 7fa8c8d19640 1 -- 172.21.15.143:0/1860917242 wait complete. 2024-05-08T10:24:26.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.126+0000 7fa8c8d19640 1 Processor -- start 2024-05-08T10:24:26.113 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.126+0000 7fa8c8d19640 1 -- start start 2024-05-08T10:24:26.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c8d19640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c4070e50 0x7fa8c4158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:26.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c8d19640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8c40cf5a0 0x7fa8c40b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:26.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c8d19640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40d3b60 0x7fa8c40b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:26.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c8d19640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c4071a20 con 0x7fa8c40d3b60 2024-05-08T10:24:26.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c8d19640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40b7e20 con 0x7fa8c4070e50 2024-05-08T10:24:26.115 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c8d19640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c4071d00 con 0x7fa8c40cf5a0 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c2d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40d3b60 0x7fa8c40b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c2d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40d3b60 0x7fa8c40b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39034/0 (socket says 172.21.15.143:39034) 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c2d9d640 1 -- 172.21.15.143:0/4145642808 learned_addr learned my addr 172.21.15.143:0/4145642808 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c1d9b640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8c40cf5a0 0x7fa8c40b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c259c640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c4070e50 0x7fa8c4158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c2d9d640 1 -- 172.21.15.143:0/4145642808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8c40cf5a0 msgr2=0x7fa8c40b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c2d9d640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8c40cf5a0 0x7fa8c40b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c2d9d640 1 -- 172.21.15.143:0/4145642808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c4070e50 msgr2=0x7fa8c4158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c2d9d640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c4070e50 0x7fa8c4158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c2d9d640 1 -- 172.21.15.143:0/4145642808 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c41f9b90 con 0x7fa8c40d3b60 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c259c640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c4070e50 0x7fa8c4158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.127+0000 7fa8c2d9d640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40d3b60 0x7fa8c40b1760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc034040 tx=0x7fa8bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:26.116 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.128+0000 7fa8b2ffd640 1 -- 172.21.15.143:0/4145642808 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc041020 con 0x7fa8c40d3b60 2024-05-08T10:24:26.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.128+0000 7fa8b2ffd640 1 -- 172.21.15.143:0/4145642808 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0077a0 con 0x7fa8c40d3b60 2024-05-08T10:24:26.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.128+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c40b3210 con 0x7fa8c40d3b60 2024-05-08T10:24:26.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.128+0000 7fa8b2ffd640 1 -- 172.21.15.143:0/4145642808 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc036040 con 0x7fa8c40d3b60 2024-05-08T10:24:26.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.128+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c41f8dd0 con 0x7fa8c40d3b60 2024-05-08T10:24:26.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.129+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c406a550 con 0x7fa8c40d3b60 2024-05-08T10:24:26.117 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.129+0000 7fa8b2ffd640 1 -- 172.21.15.143:0/4145642808 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa8bc044020 con 0x7fa8c40d3b60 2024-05-08T10:24:26.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.130+0000 7fa8b2ffd640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa8a40762d0 0x7fa8a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:26.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.130+0000 7fa8c259c640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa8a40762d0 0x7fa8a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:26.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.130+0000 7fa8b2ffd640 1 -- 172.21.15.143:0/4145642808 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fa8bc0b7e70 con 0x7fa8c40d3b60 2024-05-08T10:24:26.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.130+0000 7fa8c259c640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa8a40762d0 0x7fa8a4078790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4006fd0 tx=0x7fa8b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:26.120 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.134+0000 7fa8b2ffd640 1 -- 172.21.15.143:0/4145642808 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa8bc04b030 con 0x7fa8c40d3b60 2024-05-08T10:24:26.195 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:24:26.198 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:24:26.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:26.320+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa8c415f240 con 0x7fa8c40d3b60 2024-05-08T10:24:27.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.181+0000 7fa8b2ffd640 1 -- 172.21.15.143:0/4145642808 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7fa8c40b3210 con 0x7fa8c40d3b60 2024-05-08T10:24:27.167 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' created 2024-05-08T10:24:27.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa8a40762d0 msgr2=0x7fa8a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:27.170 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa8a40762d0 0x7fa8a4078790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4006fd0 tx=0x7fa8b4008040 comp rx=0 tx=0).stop 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40d3b60 msgr2=0x7fa8c40b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40d3b60 0x7fa8c40b1760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc034040 tx=0x7fa8bc004a40 comp rx=0 tx=0).stop 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 shutdown_connections 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa8a40762d0 0x7fa8a4078790 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c40d3b60 0x7fa8c40b1760 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8c40cf5a0 0x7fa8c40b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 --2- 172.21.15.143:0/4145642808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c4070e50 0x7fa8c4158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 >> 172.21.15.143:0/4145642808 conn(0x7fa8c40d3040 msgr2=0x7fa8c40d1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 shutdown_connections 2024-05-08T10:24:27.171 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.184+0000 7fa8c8d19640 1 -- 172.21.15.143:0/4145642808 wait complete. 2024-05-08T10:24:27.186 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T10:24:27.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.310+0000 7efc5cdf0640 1 Processor -- start 2024-05-08T10:24:27.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.310+0000 7efc5cdf0640 1 -- start start 2024-05-08T10:24:27.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc5cdf0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efc5806d330 0x7efc5806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:27.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc5cdf0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc58148a00 con 0x7efc58148cc0 2024-05-08T10:24:27.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc5cdf0640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc580b0b20 con 0x7efc58148620 2024-05-08T10:24:27.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc5cdf0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7efc5806eac0 con 0x7efc5806d330 2024-05-08T10:24:27.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc56d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efc5806d330 0x7efc5806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:27.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc4dd9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7efc58148cc0 0x7efc580b0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:32992/0 (socket says 172.21.15.143:32992) 2024-05-08T10:24:27.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc56d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efc5806d330 0x7efc5806d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39036/0 (socket says 172.21.15.143:39036) 2024-05-08T10:24:27.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc4dd9b640 1 -- 172.21.15.143:0/2295168240 learned_addr learned my addr 172.21.15.143:0/2295168240 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:27.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc56d9d640 1 -- 172.21.15.143:0/2295168240 >> v1:172.21.15.163:6789/0 conn(0x7efc58148620 legacy=0x7efc5806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:27.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc56d9d640 1 -- 172.21.15.143:0/2295168240 >> v1:172.21.15.143:6789/0 conn(0x7efc58148cc0 legacy=0x7efc580b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:27.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc56d9d640 1 -- 172.21.15.143:0/2295168240 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5806eda0 con 0x7efc5806d330 2024-05-08T10:24:27.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.311+0000 7efc55d9b640 1 -- 172.21.15.143:0/2295168240 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970022402 0 0) 0x7efc58148a00 con 0x7efc58148cc0 2024-05-08T10:24:27.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc56d9d640 1 --2- 172.21.15.143:0/2295168240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc5806d330 0x7efc5806d7c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efc50009d90 tx=0x7efc5002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7702a35e405e5723 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:27.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc55d9b640 1 -- 172.21.15.143:0/2295168240 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc50007740 con 0x7efc5806d330 2024-05-08T10:24:27.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc55d9b640 1 -- 172.21.15.143:0/2295168240 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc500078e0 con 0x7efc5806d330 2024-05-08T10:24:27.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc55d9b640 1 -- 172.21.15.143:0/2295168240 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc50007cb0 con 0x7efc5806d330 2024-05-08T10:24:27.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc5cdf0640 1 -- 172.21.15.143:0/2295168240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc5806d330 msgr2=0x7efc5806d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:27.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc5cdf0640 1 --2- 172.21.15.143:0/2295168240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc5806d330 0x7efc5806d7c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efc50009d90 tx=0x7efc5002a660 comp rx=0 tx=0).stop 2024-05-08T10:24:27.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc5cdf0640 1 -- 172.21.15.143:0/2295168240 shutdown_connections 2024-05-08T10:24:27.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc5cdf0640 1 --2- 172.21.15.143:0/2295168240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc5806d330 0x7efc5806d7c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:27.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc5cdf0640 1 -- 172.21.15.143:0/2295168240 >> 172.21.15.143:0/2295168240 conn(0x7efc580b3b50 msgr2=0x7efc58072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:27.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc5cdf0640 1 -- 172.21.15.143:0/2295168240 shutdown_connections 2024-05-08T10:24:27.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.312+0000 7efc5cdf0640 1 -- 172.21.15.143:0/2295168240 wait complete. 2024-05-08T10:24:27.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.314+0000 7efc5cdf0640 1 Processor -- start 2024-05-08T10:24:27.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.314+0000 7efc5cdf0640 1 -- start start 2024-05-08T10:24:27.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc5cdf0640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc5806d330 0x7efc58144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:27.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc5cdf0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc58148620 0x7efc580c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:27.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc5cdf0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc58148cc0 0x7efc580c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:27.310 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc5cdf0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efc580b47c0 con 0x7efc58148cc0 2024-05-08T10:24:27.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc5cdf0640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efc5806f360 con 0x7efc5806d330 2024-05-08T10:24:27.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc5cdf0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7efc580b4940 con 0x7efc58148620 2024-05-08T10:24:27.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc56d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc58148cc0 0x7efc580c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:27.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc56d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc58148cc0 0x7efc580c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39042/0 (socket says 172.21.15.143:39042) 2024-05-08T10:24:27.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc56d9d640 1 -- 172.21.15.143:0/355083868 learned_addr learned my addr 172.21.15.143:0/355083868 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:27.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc5659c640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc5806d330 0x7efc58144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:27.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc4dd9b640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc58148620 0x7efc580c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:27.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc56d9d640 1 -- 172.21.15.143:0/355083868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc58148620 msgr2=0x7efc580c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:27.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc56d9d640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc58148620 0x7efc580c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:27.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc56d9d640 1 -- 172.21.15.143:0/355083868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc5806d330 msgr2=0x7efc58144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:27.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc56d9d640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc5806d330 0x7efc58144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:27.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc56d9d640 1 -- 172.21.15.143:0/355083868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc580c7de0 con 0x7efc58148cc0 2024-05-08T10:24:27.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc56d9d640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc58148cc0 0x7efc580c78a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efc50009eb0 tx=0x7efc50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:27.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc4f7fe640 1 -- 172.21.15.143:0/355083868 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc50040070 con 0x7efc58148cc0 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc4f7fe640 1 -- 172.21.15.143:0/355083868 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc50031c90 con 0x7efc58148cc0 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.315+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc580cefe0 con 0x7efc58148cc0 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.316+0000 7efc4f7fe640 1 -- 172.21.15.143:0/355083868 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc50045680 con 0x7efc58148cc0 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.316+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc580cf710 con 0x7efc58148cc0 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.316+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5806a550 con 0x7efc58148cc0 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.317+0000 7efc4f7fe640 1 -- 172.21.15.143:0/355083868 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc50039040 con 0x7efc58148cc0 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.318+0000 7efc4f7fe640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efc380762d0 0x7efc38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.318+0000 7efc5659c640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efc380762d0 0x7efc38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.318+0000 7efc4f7fe640 1 -- 172.21.15.143:0/355083868 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7efc500b8cc0 con 0x7efc58148cc0 2024-05-08T10:24:27.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.318+0000 7efc5659c640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efc380762d0 0x7efc38078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efc480017f0 tx=0x7efc48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:27.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.322+0000 7efc4f7fe640 1 -- 172.21.15.143:0/355083868 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efc50082300 con 0x7efc58148cc0 2024-05-08T10:24:27.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:27.507+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efc580cfab0 con 0x7efc58148cc0 2024-05-08T10:24:28.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.188+0000 7efc4f7fe640 1 -- 172.21.15.143:0/355083868 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7efc50086600 con 0x7efc58148cc0 2024-05-08T10:24:28.175 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' created 2024-05-08T10:24:28.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efc380762d0 msgr2=0x7efc38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:28.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efc380762d0 0x7efc38078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efc480017f0 tx=0x7efc48009040 comp rx=0 tx=0).stop 2024-05-08T10:24:28.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc58148cc0 msgr2=0x7efc580c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:28.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc58148cc0 0x7efc580c78a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efc50009eb0 tx=0x7efc50004a40 comp rx=0 tx=0).stop 2024-05-08T10:24:28.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 shutdown_connections 2024-05-08T10:24:28.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7efc380762d0 0x7efc38078790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:28.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc58148cc0 0x7efc580c78a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:28.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc58148620 0x7efc580c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:28.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 --2- 172.21.15.143:0/355083868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc5806d330 0x7efc58144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:28.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 >> 172.21.15.143:0/355083868 conn(0x7efc580b3b50 msgr2=0x7efc5806f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:28.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 shutdown_connections 2024-05-08T10:24:28.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.190+0000 7efc5cdf0640 1 -- 172.21.15.143:0/355083868 wait complete. 2024-05-08T10:24:28.197 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T10:24:28.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.315+0000 7f84e626d640 1 Processor -- start 2024-05-08T10:24:28.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.315+0000 7f84e626d640 1 -- start start 2024-05-08T10:24:28.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84e626d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e00d36b0 0x7f84e00b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:28.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84e626d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e0162fd0 con 0x7f84e00b68f0 2024-05-08T10:24:28.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84e626d640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e01632b0 con 0x7f84e0148d90 2024-05-08T10:24:28.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84e626d640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f84e00b7070 con 0x7f84e00d36b0 2024-05-08T10:24:28.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84e480a640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f84e00b68f0 0x7f84e006d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33000/0 (socket says 172.21.15.143:33000) 2024-05-08T10:24:28.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84e480a640 1 -- 172.21.15.143:0/4180675177 learned_addr learned my addr 172.21.15.143:0/4180675177 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:28.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84df7fe640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e00d36b0 0x7f84e00b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:28.305 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 348163541 0 0) 0x7f84e0162fd0 con 0x7f84e00b68f0 2024-05-08T10:24:28.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84c8003520 con 0x7f84e00b68f0 2024-05-08T10:24:28.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460326566 0 0) 0x7f84e01632b0 con 0x7f84e0148d90 2024-05-08T10:24:28.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.316+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84e0162fd0 con 0x7f84e0148d90 2024-05-08T10:24:28.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 699847129 0 0) 0x7f84c8003520 con 0x7f84e00b68f0 2024-05-08T10:24:28.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e00d36b0 msgr2=0x7f84e00b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:28.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e00d36b0 0x7f84e00b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:28.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 >> v1:172.21.15.163:6789/0 conn(0x7f84e0148d90 legacy=0x7f84e00d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:28.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e0163590 con 0x7f84e00b68f0 2024-05-08T10:24:28.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f84d8001a70 con 0x7f84e00b68f0 2024-05-08T10:24:28.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 >> v1:172.21.15.143:6789/0 conn(0x7f84e00b68f0 legacy=0x7f84e006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:28.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e00d36b0 0x7f84c8003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:28.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84c8004210 0x7f84c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:28.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:28.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00b7070 con 0x7f84c8004d90 2024-05-08T10:24:28.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f84c800bc70 con 0x7f84c8004210 2024-05-08T10:24:28.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f84c800be70 con 0x7f84e00d36b0 2024-05-08T10:24:28.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84e480a640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84df7fe640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84c8004210 0x7f84c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84dffff640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e00d36b0 0x7f84c8003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84e480a640 1 -- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e00d36b0 msgr2=0x7f84c8003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84e480a640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e00d36b0 0x7f84c8003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84e480a640 1 -- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84c8004210 msgr2=0x7f84c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84e480a640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84c8004210 0x7f84c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.317+0000 7f84e480a640 1 -- 172.21.15.143:0/4180675177 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c8003520 con 0x7f84c8004d90 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.318+0000 7f84e480a640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84c8005210 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f84d800a7f0 tx=0x7f84c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71455b073ba5f6f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.318+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d800a410 con 0x7f84c8004d90 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.318+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d802f070 con 0x7f84c8004d90 2024-05-08T10:24:28.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.318+0000 7f84deffd640 1 -- 172.21.15.143:0/4180675177 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d802bb90 con 0x7f84c8004d90 2024-05-08T10:24:28.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.318+0000 7f84e626d640 1 -- 172.21.15.143:0/4180675177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 msgr2=0x7f84c8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:28.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.318+0000 7f84e626d640 1 --2- 172.21.15.143:0/4180675177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84c8005210 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f84d800a7f0 tx=0x7f84c8005830 comp rx=0 tx=0).stop 2024-05-08T10:24:28.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.318+0000 7f84e480a640 1 -- 172.21.15.143:0/4180675177 reap_dead start 2024-05-08T10:24:28.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.318+0000 7f84e626d640 1 -- 172.21.15.143:0/4180675177 shutdown_connections 2024-05-08T10:24:28.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.318+0000 7f84e626d640 1 -- 172.21.15.143:0/4180675177 >> 172.21.15.143:0/4180675177 conn(0x7f84e00b4da0 msgr2=0x7f84e00b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:28.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.319+0000 7f84e626d640 1 -- 172.21.15.143:0/4180675177 shutdown_connections 2024-05-08T10:24:28.309 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.319+0000 7f84e626d640 1 -- 172.21.15.143:0/4180675177 wait complete. 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.320+0000 7f84e626d640 1 Processor -- start 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.320+0000 7f84e626d640 1 -- start start 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84e626d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84e01e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84e626d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84e01f9680 0x7f84e013faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84e626d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e015aa90 0x7f84e015af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84e626d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00b6d40 con 0x7f84c8004d90 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84e626d640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f84e0163d90 con 0x7f84e01f9680 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84e626d640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f84e00b63b0 con 0x7f84e015aa90 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84e01e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:28.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84e01e9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39058/0 (socket says 172.21.15.143:39058) 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dffff640 1 -- 172.21.15.143:0/1762279448 learned_addr learned my addr 172.21.15.143:0/1762279448 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84df7fe640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84e01f9680 0x7f84e013faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84e480a640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e015aa90 0x7f84e015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dffff640 1 -- 172.21.15.143:0/1762279448 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e015aa90 msgr2=0x7f84e015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dffff640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e015aa90 0x7f84e015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dffff640 1 -- 172.21.15.143:0/1762279448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84e01f9680 msgr2=0x7f84e013faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dffff640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84e01f9680 0x7f84e013faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dffff640 1 -- 172.21.15.143:0/1762279448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e01f9ae0 con 0x7f84c8004d90 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dffff640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84e01e9c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84d000f7b0 tx=0x7f84d000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dcff9640 1 -- 172.21.15.143:0/1762279448 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d00050d0 con 0x7f84c8004d90 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dcff9640 1 -- 172.21.15.143:0/1762279448 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d0018070 con 0x7f84c8004d90 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84dcff9640 1 -- 172.21.15.143:0/1762279448 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d000d730 con 0x7f84c8004d90 2024-05-08T10:24:28.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e015b450 con 0x7f84c8004d90 2024-05-08T10:24:28.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.321+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e01ea5e0 con 0x7f84c8004d90 2024-05-08T10:24:28.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.322+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e006a550 con 0x7f84c8004d90 2024-05-08T10:24:28.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.323+0000 7f84dcff9640 1 -- 172.21.15.143:0/1762279448 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84d000d8d0 con 0x7f84c8004d90 2024-05-08T10:24:28.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.324+0000 7f84dcff9640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f84cc076300 0x7f84cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:28.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.324+0000 7f84df7fe640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f84cc076300 0x7f84cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:28.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.324+0000 7f84dcff9640 1 -- 172.21.15.143:0/1762279448 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7f84d0097440 con 0x7f84c8004d90 2024-05-08T10:24:28.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.324+0000 7f84df7fe640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f84cc076300 0x7f84cc0787c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f84e013f380 tx=0x7f84d4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:28.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.328+0000 7f84dcff9640 1 -- 172.21.15.143:0/1762279448 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f84d0060e00 con 0x7f84c8004d90 2024-05-08T10:24:28.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:28.548+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f84e00b5af0 con 0x7f84c8004d90 2024-05-08T10:24:29.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.196+0000 7f84dcff9640 1 -- 172.21.15.143:0/1762279448 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f84d0060700 con 0x7f84c8004d90 2024-05-08T10:24:29.183 INFO:teuthology.orchestra.run.smithi143.stderr:new fs with metadata pool 4 and data pool 5 2024-05-08T10:24:29.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.201+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f84cc076300 msgr2=0x7f84cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.201+0000 7f84e626d640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f84cc076300 0x7f84cc0787c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f84e013f380 tx=0x7f84d4009190 comp rx=0 tx=0).stop 2024-05-08T10:24:29.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.201+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 msgr2=0x7f84e01e9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.201+0000 7f84e626d640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84e01e9c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84d000f7b0 tx=0x7f84d000fbb0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.202+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 shutdown_connections 2024-05-08T10:24:29.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.202+0000 7f84e626d640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84e015aa90 0x7f84e015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.202+0000 7f84e626d640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84e01f9680 0x7f84e013faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.202+0000 7f84e626d640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f84cc076300 0x7f84cc0787c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.202+0000 7f84e626d640 1 --2- 172.21.15.143:0/1762279448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84c8004d90 0x7f84e01e9c70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.202+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 >> 172.21.15.143:0/1762279448 conn(0x7f84e00b4da0 msgr2=0x7f84e006d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:29.192 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.205+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 shutdown_connections 2024-05-08T10:24:29.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.206+0000 7f84e626d640 1 -- 172.21.15.143:0/1762279448 wait complete. 2024-05-08T10:24:29.217 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:29.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.332+0000 7fd96e9a5640 1 Processor -- start 2024-05-08T10:24:29.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.332+0000 7fd96e9a5640 1 -- start start 2024-05-08T10:24:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd96e9a5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd9680d3a70 0x7fd96815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd96e9a5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd96e9a5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd968160e30 con 0x7fd9680d0090 2024-05-08T10:24:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd96e9a5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd968161bf0 con 0x7fd9680d3a70 2024-05-08T10:24:29.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd96e9a5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd968161110 con 0x7fd96815dea0 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd95ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd9680d3a70 0x7fd96815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd95ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd9680d3a70 0x7fd96815d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39066/0 (socket says 172.21.15.143:39066) 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd967fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd9680d0090 0x7fd9680d3360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33016/0 (socket says 172.21.15.143:33016) 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd95ffff640 1 -- 172.21.15.143:0/1902138911 learned_addr learned my addr 172.21.15.143:0/1902138911 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd96cf42640 1 --2- 172.21.15.143:0/1902138911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd95ffff640 1 -- 172.21.15.143:0/1902138911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 msgr2=0x7fd9681427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd95ffff640 1 --2- 172.21.15.143:0/1902138911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd95ffff640 1 -- 172.21.15.143:0/1902138911 >> v1:172.21.15.143:6789/0 conn(0x7fd9680d0090 legacy=0x7fd9680d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd95ffff640 1 -- 172.21.15.143:0/1902138911 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9681613f0 con 0x7fd9680d3a70 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd9677fe640 1 -- 172.21.15.143:0/1902138911 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429679265 0 0) 0x7fd968160e30 con 0x7fd9680d0090 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.333+0000 7fd96cf42640 1 --2- 172.21.15.143:0/1902138911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.334+0000 7fd95ffff640 1 --2- 172.21.15.143:0/1902138911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 0x7fd96815d960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd950009870 tx=0x7fd95002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4c96be2b492653 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:29.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.334+0000 7fd9677fe640 1 -- 172.21.15.143:0/1902138911 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950037070 con 0x7fd9680d3a70 2024-05-08T10:24:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.334+0000 7fd9677fe640 1 -- 172.21.15.143:0/1902138911 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd950032440 con 0x7fd9680d3a70 2024-05-08T10:24:29.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.334+0000 7fd9677fe640 1 -- 172.21.15.143:0/1902138911 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950032810 con 0x7fd9680d3a70 2024-05-08T10:24:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.335+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1902138911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 msgr2=0x7fd96815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.335+0000 7fd96e9a5640 1 --2- 172.21.15.143:0/1902138911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 0x7fd96815d960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd950009870 tx=0x7fd95002a270 comp rx=0 tx=0).stop 2024-05-08T10:24:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.335+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1902138911 shutdown_connections 2024-05-08T10:24:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.335+0000 7fd96e9a5640 1 --2- 172.21.15.143:0/1902138911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.335+0000 7fd96e9a5640 1 --2- 172.21.15.143:0/1902138911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 0x7fd96815d960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.335+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1902138911 >> 172.21.15.143:0/1902138911 conn(0x7fd9680682f0 msgr2=0x7fd968068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.335+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1902138911 shutdown_connections 2024-05-08T10:24:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.335+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1902138911 wait complete. 2024-05-08T10:24:29.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.336+0000 7fd96e9a5640 1 Processor -- start 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.336+0000 7fd96e9a5640 1 -- start start 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96e9a5640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9680d0090 0x7fd96806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96e9a5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 0x7fd9680c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96e9a5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96e9a5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd9680d1a70 con 0x7fd9680d3a70 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96e9a5640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd96815e350 con 0x7fd9680d0090 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96e9a5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd9680d1bf0 con 0x7fd96815dea0 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd95ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 0x7fd9680c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd95ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 0x7fd9680c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39070/0 (socket says 172.21.15.143:39070) 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd95ffff640 1 -- 172.21.15.143:0/1992516993 learned_addr learned my addr 172.21.15.143:0/1992516993 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96cf42640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd95ffff640 1 -- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 msgr2=0x7fd9681f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd95ffff640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd967fff640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9680d0090 0x7fd96806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd95ffff640 1 -- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9680d0090 msgr2=0x7fd96806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd95ffff640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9680d0090 0x7fd96806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd95ffff640 1 -- 172.21.15.143:0/1992516993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96806e6e0 con 0x7fd9680d3a70 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96cf42640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd967fff640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9680d0090 0x7fd96806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd95ffff640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 0x7fd9680c8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd950035040 tx=0x7fd9500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd9657fa640 1 -- 172.21.15.143:0/1992516993 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950037040 con 0x7fd9680d3a70 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd9657fa640 1 -- 172.21.15.143:0/1992516993 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd950004230 con 0x7fd9680d3a70 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96806e9c0 con 0x7fd9680d3a70 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd9657fa640 1 -- 172.21.15.143:0/1992516993 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95003c670 con 0x7fd9680d3a70 2024-05-08T10:24:29.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.337+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96806f260 con 0x7fd9680d3a70 2024-05-08T10:24:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.338+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd96806eb90 con 0x7fd9680d3a70 2024-05-08T10:24:29.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.339+0000 7fd9657fa640 1 -- 172.21.15.143:0/1992516993 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd95003a070 con 0x7fd9680d3a70 2024-05-08T10:24:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.340+0000 7fd9657fa640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd9480762d0 0x7fd948078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.340+0000 7fd9657fa640 1 -- 172.21.15.143:0/1992516993 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fd9500b7d70 con 0x7fd9680d3a70 2024-05-08T10:24:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.340+0000 7fd967fff640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd9480762d0 0x7fd948078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.329 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.340+0000 7fd967fff640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd9480762d0 0x7fd948078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd958000f60 tx=0x7fd958009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:29.330 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.344+0000 7fd9657fa640 1 -- 172.21.15.143:0/1992516993 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd950041020 con 0x7fd9680d3a70 2024-05-08T10:24:29.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.524+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd968075dc0 con 0x7fd9680d3a70 2024-05-08T10:24:29.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.525+0000 7fd9657fa640 1 -- 172.21.15.143:0/1992516993 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7fd9500816d0 con 0x7fd9680d3a70 2024-05-08T10:24:29.512 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:29.512 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":30,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:24:28.550427+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:24:26.325731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:24:27.512735+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd9480762d0 msgr2=0x7fd948078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd9480762d0 0x7fd948078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd958000f60 tx=0x7fd958009040 comp rx=0 tx=0).stop 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 msgr2=0x7fd9680c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 0x7fd9680c8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd950035040 tx=0x7fd9500046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 shutdown_connections 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd96815dea0 0x7fd9681f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd9480762d0 0x7fd948078790 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd9680d3a70 0x7fd9680c8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 --2- 172.21.15.143:0/1992516993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9680d0090 0x7fd96806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.527+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 >> 172.21.15.143:0/1992516993 conn(0x7fd9680682f0 msgr2=0x7fd9680b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:29.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.528+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 shutdown_connections 2024-05-08T10:24:29.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.528+0000 7fd96e9a5640 1 -- 172.21.15.143:0/1992516993 wait complete. 2024-05-08T10:24:29.526 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:29.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.640+0000 7f67f03e5640 1 Processor -- start 2024-05-08T10:24:29.627 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.641+0000 7f67f03e5640 1 -- start start 2024-05-08T10:24:29.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.641+0000 7f67f03e5640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f67e815f760 0x7f67e80b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.641+0000 7f67f03e5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67e80d0a00 0x7f67e80b8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.641+0000 7f67f03e5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e80d0070 con 0x7f67e80cfc10 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.641+0000 7f67f03e5640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f67e815fb40 con 0x7f67e815f760 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.641+0000 7f67f03e5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f67e80d36f0 con 0x7f67e80d0a00 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed980640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f67e80cfc10 0x7f67e80d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33030/0 (socket says 172.21.15.143:33030) 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed980640 1 -- 172.21.15.143:0/677064062 learned_addr learned my addr 172.21.15.143:0/677064062 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ee181640 1 --2- 172.21.15.143:0/677064062 >> v2:172.21.15.163:3300/0 conn(0x7f67e815f760 0x7f67e80b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ee982640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67e80d0a00 0x7f67e80b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132774681 0 0) 0x7f67dc001110 con 0x7f67e80cfc10 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67d0003520 con 0x7f67e80cfc10 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 922196268 0 0) 0x7f67d0003520 con 0x7f67e80cfc10 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67e80d0a00 msgr2=0x7f67e80b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67e80d0a00 0x7f67e80b8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 >> v2:172.21.15.163:3300/0 conn(0x7f67e815f760 msgr2=0x7f67e80b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 --2- 172.21.15.143:0/677064062 >> v2:172.21.15.163:3300/0 conn(0x7f67e815f760 0x7f67e80b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e80d39d0 con 0x7f67e80cfc10 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f67dc0018c0 con 0x7f67e80cfc10 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 >> v1:172.21.15.143:6789/0 conn(0x7f67e80cfc10 legacy=0x7f67e80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d0003a00 0x7f67d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d0004800 0x7f67d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67e80d0a00 0x7f67d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f67e815fb40 con 0x7f67d0004800 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f67e80d36f0 con 0x7f67d0003a00 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f67d000ba70 con 0x7f67e80d0a00 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ed980640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d0004800 0x7f67d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ee181640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d0003a00 0x7f67d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.642+0000 7f67ee982640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67e80d0a00 0x7f67d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.643+0000 7f67ed980640 1 -- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67e80d0a00 msgr2=0x7f67d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.643+0000 7f67ed980640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67e80d0a00 0x7f67d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.643+0000 7f67ed980640 1 -- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d0003a00 msgr2=0x7f67d0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.643+0000 7f67ed980640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67d0003a00 0x7f67d0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.643+0000 7f67ed980640 1 -- 172.21.15.143:0/677064062 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d0003520 con 0x7f67d0004800 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.643+0000 7f67ed980640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d0004800 0x7f67d0004c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00c3e0 tx=0x7f67d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839a91f72361e8ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.643+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00c0e0 con 0x7f67d0004800 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.644+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc034070 con 0x7f67d0004800 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.644+0000 7f67ed17f640 1 -- 172.21.15.143:0/677064062 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc005d30 con 0x7f67d0004800 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.644+0000 7f67f03e5640 1 -- 172.21.15.143:0/677064062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d0004800 msgr2=0x7f67d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.644+0000 7f67f03e5640 1 --2- 172.21.15.143:0/677064062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67d0004800 0x7f67d0004c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00c3e0 tx=0x7f67d0005830 comp rx=0 tx=0).stop 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.644+0000 7f67ee982640 1 -- 172.21.15.143:0/677064062 reap_dead start 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.644+0000 7f67f03e5640 1 -- 172.21.15.143:0/677064062 shutdown_connections 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.644+0000 7f67f03e5640 1 -- 172.21.15.143:0/677064062 >> 172.21.15.143:0/677064062 conn(0x7f67e80740e0 msgr2=0x7f67e806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:29.633 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.644+0000 7f67f03e5640 1 -- 172.21.15.143:0/677064062 shutdown_connections 2024-05-08T10:24:29.634 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.644+0000 7f67f03e5640 1 -- 172.21.15.143:0/677064062 wait complete. 2024-05-08T10:24:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.645+0000 7f67f03e5640 1 Processor -- start 2024-05-08T10:24:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.645+0000 7f67f03e5640 1 -- start start 2024-05-08T10:24:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67f03e5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d0004800 0x7f67e81f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67f03e5640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67e815b180 0x7f67e81f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67f03e5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67e80b7440 0x7f67e81f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67f03e5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f67e80d4270 con 0x7f67e80b7440 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67f03e5640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f67e80d3f90 con 0x7f67e815b180 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67f03e5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f67e80d4790 con 0x7f67d0004800 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67ee982640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67e80b7440 0x7f67e81f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67ee982640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67e80b7440 0x7f67e81f87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39098/0 (socket says 172.21.15.143:39098) 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67ee982640 1 -- 172.21.15.143:0/3108207684 learned_addr learned my addr 172.21.15.143:0/3108207684 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67ee982640 1 -- 172.21.15.143:0/3108207684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d0004800 msgr2=0x7f67e81f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67ee982640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d0004800 0x7f67e81f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67ee982640 1 -- 172.21.15.143:0/3108207684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67e815b180 msgr2=0x7f67e81f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67ed980640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67e815b180 0x7f67e81f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67ee982640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67e815b180 0x7f67e81f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.646+0000 7f67ee982640 1 -- 172.21.15.143:0/3108207684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e80b79d0 con 0x7f67e80b7440 2024-05-08T10:24:29.637 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.647+0000 7f67ee982640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67e80b7440 0x7f67e81f87d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f67e80d2830 tx=0x7f67d800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.647+0000 7f67e6ffd640 1 -- 172.21.15.143:0/3108207684 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d800fe10 con 0x7f67e80b7440 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.647+0000 7f67e6ffd640 1 -- 172.21.15.143:0/3108207684 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d801d070 con 0x7f67e80b7440 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.647+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e815a6a0 con 0x7f67e80b7440 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.647+0000 7f67e6ffd640 1 -- 172.21.15.143:0/3108207684 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8015670 con 0x7f67e80b7440 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.647+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e815ac60 con 0x7f67e80b7440 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.648+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e815ae60 con 0x7f67e80b7440 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.648+0000 7f67e6ffd640 1 -- 172.21.15.143:0/3108207684 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f67d8015810 con 0x7f67e80b7440 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.649+0000 7f67e6ffd640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67d4076300 0x7f67d40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.649+0000 7f67ee181640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67d4076300 0x7f67d40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.649+0000 7f67e6ffd640 1 -- 172.21.15.143:0/3108207684 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f67d8097df0 con 0x7f67e80b7440 2024-05-08T10:24:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.649+0000 7f67ee181640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67d4076300 0x7f67d40787c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67e0006b10 tx=0x7f67e0006aa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.653+0000 7f67e6ffd640 1 -- 172.21.15.143:0/3108207684 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f67e815ae60 con 0x7f67e80b7440 2024-05-08T10:24:29.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.833+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67e806a550 con 0x7f67e80b7440 2024-05-08T10:24:29.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.834+0000 7f67e6ffd640 1 -- 172.21.15.143:0/3108207684 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7f67d8010040 con 0x7f67e80b7440 2024-05-08T10:24:29.820 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:29.821 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":30,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:24:28.550427+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:24:26.325731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:24:27.512735+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67d4076300 msgr2=0x7f67d40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67d4076300 0x7f67d40787c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67e0006b10 tx=0x7f67e0006aa0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67e80b7440 msgr2=0x7f67e81f87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67e80b7440 0x7f67e81f87d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f67e80d2830 tx=0x7f67d800f580 comp rx=0 tx=0).stop 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 shutdown_connections 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f67d4076300 0x7f67d40787c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67e80b7440 0x7f67e81f87d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67e815b180 0x7f67e81f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 --2- 172.21.15.143:0/3108207684 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67d0004800 0x7f67e81f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.836+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 >> 172.21.15.143:0/3108207684 conn(0x7f67e80740e0 msgr2=0x7f67e80c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.837+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 shutdown_connections 2024-05-08T10:24:29.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.837+0000 7f67f03e5640 1 -- 172.21.15.143:0/3108207684 wait complete. 2024-05-08T10:24:29.834 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T10:24:29.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.950+0000 7fc97e0d9640 1 Processor -- start 2024-05-08T10:24:29.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.950+0000 7fc97e0d9640 1 -- start start 2024-05-08T10:24:29.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.951+0000 7fc97e0d9640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc9780d20d0 0x7fc9780d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.951+0000 7fc97e0d9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc978163250 0x7fc978163630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.951+0000 7fc97e0d9640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc978163f00 con 0x7fc97815f5a0 2024-05-08T10:24:29.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.951+0000 7fc97e0d9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc9780cfe20 con 0x7fc978163250 2024-05-08T10:24:29.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.951+0000 7fc97e0d9640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc9780d0100 con 0x7fc9780d20d0 2024-05-08T10:24:29.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.951+0000 7fc977fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc978163250 0x7fc978163630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.951+0000 7fc977fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc978163250 0x7fc978163630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39102/0 (socket says 172.21.15.143:39102) 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.951+0000 7fc977fff640 1 -- 172.21.15.143:0/512667962 learned_addr learned my addr 172.21.15.143:0/512667962 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.952+0000 7fc96effd640 1 --2- 172.21.15.143:0/512667962 >> v2:172.21.15.163:3300/0 conn(0x7fc9780d20d0 0x7fc9780d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.952+0000 7fc977fff640 1 -- 172.21.15.143:0/512667962 >> v2:172.21.15.163:3300/0 conn(0x7fc9780d20d0 msgr2=0x7fc9780d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.952+0000 7fc977fff640 1 --2- 172.21.15.143:0/512667962 >> v2:172.21.15.163:3300/0 conn(0x7fc9780d20d0 0x7fc9780d0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.952+0000 7fc977fff640 1 -- 172.21.15.143:0/512667962 >> v1:172.21.15.163:6789/0 conn(0x7fc97815f5a0 legacy=0x7fc9780d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.952+0000 7fc977fff640 1 -- 172.21.15.143:0/512667962 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9780d03e0 con 0x7fc978163250 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.952+0000 7fc977fff640 1 --2- 172.21.15.143:0/512667962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc978163250 0x7fc978163630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc9780cf870 tx=0x7fc97002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296e967790fb2ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.952+0000 7fc976ffd640 1 -- 172.21.15.143:0/512667962 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970036070 con 0x7fc978163250 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc976ffd640 1 -- 172.21.15.143:0/512667962 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc970031600 con 0x7fc978163250 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc976ffd640 1 -- 172.21.15.143:0/512667962 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9700319d0 con 0x7fc978163250 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc97e0d9640 1 -- 172.21.15.143:0/512667962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc978163250 msgr2=0x7fc978163630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc97e0d9640 1 --2- 172.21.15.143:0/512667962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc978163250 0x7fc978163630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc9780cf870 tx=0x7fc97002a6a0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc97e0d9640 1 -- 172.21.15.143:0/512667962 shutdown_connections 2024-05-08T10:24:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc97e0d9640 1 --2- 172.21.15.143:0/512667962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc978163250 0x7fc978163630 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc97e0d9640 1 --2- 172.21.15.143:0/512667962 >> v2:172.21.15.163:3300/0 conn(0x7fc9780d20d0 0x7fc9780d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc97e0d9640 1 -- 172.21.15.143:0/512667962 >> 172.21.15.143:0/512667962 conn(0x7fc978074080 msgr2=0x7fc97806d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc97e0d9640 1 -- 172.21.15.143:0/512667962 shutdown_connections 2024-05-08T10:24:29.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.953+0000 7fc97e0d9640 1 -- 172.21.15.143:0/512667962 wait complete. 2024-05-08T10:24:29.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.954+0000 7fc97e0d9640 1 Processor -- start 2024-05-08T10:24:29.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.954+0000 7fc97e0d9640 1 -- start start 2024-05-08T10:24:29.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc97e0d9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9780d20d0 0x7fc9781f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc97e0d9640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97815f5a0 0x7fc97815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc97e0d9640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc978163250 0x7fc9781559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc97e0d9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc97815fb00 con 0x7fc9780d20d0 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc97e0d9640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc97815f980 con 0x7fc97815f5a0 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc97e0d9640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc9780d38e0 con 0x7fc978163250 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9780d20d0 0x7fc9781f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc9777fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9780d20d0 0x7fc9781f5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39104/0 (socket says 172.21.15.143:39104) 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc9777fe640 1 -- 172.21.15.143:0/3925717031 learned_addr learned my addr 172.21.15.143:0/3925717031 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc977fff640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc978163250 0x7fc9781559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc96effd640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97815f5a0 0x7fc97815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.955+0000 7fc9777fe640 1 -- 172.21.15.143:0/3925717031 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc978163250 msgr2=0x7fc9781559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc9777fe640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc978163250 0x7fc9781559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc9777fe640 1 -- 172.21.15.143:0/3925717031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97815f5a0 msgr2=0x7fc97815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc9777fe640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97815f5a0 0x7fc97815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc9777fe640 1 -- 172.21.15.143:0/3925717031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9781f5ba0 con 0x7fc9780d20d0 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc9777fe640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9780d20d0 0x7fc9781f5570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc96800c430 tx=0x7fc96800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc974ff9640 1 -- 172.21.15.143:0/3925717031 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968011790 con 0x7fc9780d20d0 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc974ff9640 1 -- 172.21.15.143:0/3925717031 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc968017070 con 0x7fc9780d20d0 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9781f5e80 con 0x7fc9780d20d0 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc974ff9640 1 -- 172.21.15.143:0/3925717031 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968011bb0 con 0x7fc9780d20d0 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.956+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc978155f00 con 0x7fc9780d20d0 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.957+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97806a550 con 0x7fc9780d20d0 2024-05-08T10:24:29.945 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.957+0000 7fc974ff9640 1 -- 172.21.15.143:0/3925717031 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc96801c460 con 0x7fc9780d20d0 2024-05-08T10:24:29.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.958+0000 7fc974ff9640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc958076300 0x7fc9580787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:29.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.958+0000 7fc974ff9640 1 -- 172.21.15.143:0/3925717031 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fc968097430 con 0x7fc9780d20d0 2024-05-08T10:24:29.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.958+0000 7fc96effd640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc958076300 0x7fc9580787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:29.946 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.958+0000 7fc96effd640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc958076300 0x7fc9580787c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc9781596a0 tx=0x7fc960008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:29.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:29.962+0000 7fc974ff9640 1 -- 172.21.15.143:0/3925717031 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc968060d90 con 0x7fc9780d20d0 2024-05-08T10:24:30.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.180+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc9780d4990 con 0x7fc9780d20d0 2024-05-08T10:24:30.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.202+0000 7fc974ff9640 1 -- 172.21.15.143:0/3925717031 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7fc968060690 con 0x7fc9780d20d0 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.204+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc958076300 msgr2=0x7fc9580787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.204+0000 7fc97e0d9640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc958076300 0x7fc9580787c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc9781596a0 tx=0x7fc960008040 comp rx=0 tx=0).stop 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.204+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9780d20d0 msgr2=0x7fc9781f5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.204+0000 7fc97e0d9640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9780d20d0 0x7fc9781f5570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc96800c430 tx=0x7fc96800c8f0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.204+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 shutdown_connections 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.204+0000 7fc97e0d9640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc978163250 0x7fc9781559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.204+0000 7fc97e0d9640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc97815f5a0 0x7fc97815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.204+0000 7fc97e0d9640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc958076300 0x7fc9580787c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.204+0000 7fc97e0d9640 1 --2- 172.21.15.143:0/3925717031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9780d20d0 0x7fc9781f5570 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.205+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 >> 172.21.15.143:0/3925717031 conn(0x7fc978074080 msgr2=0x7fc97815e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.205+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 shutdown_connections 2024-05-08T10:24:30.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.205+0000 7fc97e0d9640 1 -- 172.21.15.143:0/3925717031 wait complete. 2024-05-08T10:24:30.202 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-08T10:24:30.202 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T10:24:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.318+0000 7f3f4350a640 1 Processor -- start 2024-05-08T10:24:30.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.318+0000 7f3f4350a640 1 -- start start 2024-05-08T10:24:30.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f4350a640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3f3c148e20 0x7f3f3c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:30.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f4350a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 0x7f3f3c0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:30.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f4350a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3f3c0b6910 0x7f3f3c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:30.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f4350a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f3f3c06de40 con 0x7f3f3c0b6910 2024-05-08T10:24:30.306 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f4350a640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f3f3c06e0e0 con 0x7f3f3c148e20 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f4350a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3c06e3c0 con 0x7f3f3c162ea0 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f41aa7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3f3c0b6910 0x7f3f3c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f41aa7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3f3c0b6910 0x7f3f3c071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39120/0 (socket says 172.21.15.143:39120) 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f41aa7640 1 -- 172.21.15.143:0/3719569862 learned_addr learned my addr 172.21.15.143:0/3719569862 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f40aa5640 1 --2- 172.21.15.143:0/3719569862 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 0x7f3f3c0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f412a6640 1 --2- 172.21.15.143:0/3719569862 >> v2:172.21.15.163:3300/0 conn(0x7f3f3c148e20 0x7f3f3c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f41aa7640 1 -- 172.21.15.143:0/3719569862 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 msgr2=0x7f3f3c0b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f41aa7640 1 --2- 172.21.15.143:0/3719569862 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 0x7f3f3c0b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f41aa7640 1 -- 172.21.15.143:0/3719569862 >> v2:172.21.15.163:3300/0 conn(0x7f3f3c148e20 msgr2=0x7f3f3c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f41aa7640 1 --2- 172.21.15.143:0/3719569862 >> v2:172.21.15.163:3300/0 conn(0x7f3f3c148e20 0x7f3f3c06d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.319+0000 7f3f41aa7640 1 -- 172.21.15.143:0/3719569862 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c06e6a0 con 0x7f3f3c0b6910 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.320+0000 7f3f41aa7640 1 --2- 172.21.15.143:0/3719569862 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 0x7f3f3c071e20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c064080 tx=0x7f3f3402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86601a600573652 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.320+0000 7f3f3bfff640 1 -- 172.21.15.143:0/3719569862 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34037070 con 0x7f3f3c0b6910 2024-05-08T10:24:30.307 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.320+0000 7f3f3bfff640 1 -- 172.21.15.143:0/3719569862 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f34032440 con 0x7f3f3c0b6910 2024-05-08T10:24:30.308 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.320+0000 7f3f3bfff640 1 -- 172.21.15.143:0/3719569862 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34032810 con 0x7f3f3c0b6910 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.321+0000 7f3f4350a640 1 -- 172.21.15.143:0/3719569862 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 msgr2=0x7f3f3c071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.321+0000 7f3f4350a640 1 --2- 172.21.15.143:0/3719569862 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 0x7f3f3c071e20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c064080 tx=0x7f3f3402a1e0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.321+0000 7f3f4350a640 1 -- 172.21.15.143:0/3719569862 shutdown_connections 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.321+0000 7f3f4350a640 1 --2- 172.21.15.143:0/3719569862 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 0x7f3f3c071e20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.321+0000 7f3f4350a640 1 --2- 172.21.15.143:0/3719569862 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 0x7f3f3c0b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.321+0000 7f3f4350a640 1 --2- 172.21.15.143:0/3719569862 >> v2:172.21.15.163:3300/0 conn(0x7f3f3c148e20 0x7f3f3c06d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.321+0000 7f3f4350a640 1 -- 172.21.15.143:0/3719569862 >> 172.21.15.143:0/3719569862 conn(0x7f3f3c0706c0 msgr2=0x7f3f3c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.321+0000 7f3f4350a640 1 -- 172.21.15.143:0/3719569862 shutdown_connections 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.321+0000 7f3f4350a640 1 -- 172.21.15.143:0/3719569862 wait complete. 2024-05-08T10:24:30.311 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.322+0000 7f3f4350a640 1 Processor -- start 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.322+0000 7f3f4350a640 1 -- start start 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f4350a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 0x7f3f3c1f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f4350a640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f3c148e20 0x7f3f3c0d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f4350a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 0x7f3f3c0d1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f4350a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c0724e0 con 0x7f3f3c0b6910 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f4350a640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c072360 con 0x7f3f3c148e20 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f4350a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3c072660 con 0x7f3f3c162ea0 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f412a6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 0x7f3f3c1f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f412a6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 0x7f3f3c1f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39136/0 (socket says 172.21.15.143:39136) 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f412a6640 1 -- 172.21.15.143:0/743236911 learned_addr learned my addr 172.21.15.143:0/743236911 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f41aa7640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 0x7f3f3c0d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f40aa5640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f3c148e20 0x7f3f3c0d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f412a6640 1 -- 172.21.15.143:0/743236911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 msgr2=0x7f3f3c0d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:30.312 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f412a6640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 0x7f3f3c0d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f412a6640 1 -- 172.21.15.143:0/743236911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f3c148e20 msgr2=0x7f3f3c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f412a6640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f3c148e20 0x7f3f3c0d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f412a6640 1 -- 172.21.15.143:0/743236911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c0d19b0 con 0x7f3f3c0b6910 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.323+0000 7f3f412a6640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 0x7f3f3c1f6160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00ce40 tx=0x7f3f2c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.324+0000 7f3f39ffb640 1 -- 172.21.15.143:0/743236911 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c003b90 con 0x7f3f3c0b6910 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.324+0000 7f3f39ffb640 1 -- 172.21.15.143:0/743236911 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c003d30 con 0x7f3f3c0b6910 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.324+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3c0d1c90 con 0x7f3f3c0b6910 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.324+0000 7f3f39ffb640 1 -- 172.21.15.143:0/743236911 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c004260 con 0x7f3f3c0b6910 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.324+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3c0d2250 con 0x7f3f3c0b6910 2024-05-08T10:24:30.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.325+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f3c06a550 con 0x7f3f3c0b6910 2024-05-08T10:24:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.325+0000 7f3f39ffb640 1 -- 172.21.15.143:0/743236911 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f2c004400 con 0x7f3f3c0b6910 2024-05-08T10:24:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.326+0000 7f3f39ffb640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f280762d0 0x7f3f28078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.326+0000 7f3f39ffb640 1 -- 172.21.15.143:0/743236911 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3f2c0981d0 con 0x7f3f3c0b6910 2024-05-08T10:24:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.326+0000 7f3f40aa5640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f280762d0 0x7f3f28078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:30.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.326+0000 7f3f40aa5640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f280762d0 0x7f3f28078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f30006fd0 tx=0x7f3f30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:30.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.331+0000 7f3f39ffb640 1 -- 172.21.15.143:0/743236911 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3f2c061b30 con 0x7f3f3c0b6910 2024-05-08T10:24:30.532 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:30.546+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3f3c0d3d60 con 0x7f3f3c0b6910 2024-05-08T10:24:31.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.210+0000 7f3f39ffb640 1 -- 172.21.15.143:0/743236911 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7f3f2c061430 con 0x7f3f3c0b6910 2024-05-08T10:24:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f280762d0 msgr2=0x7f3f28078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f280762d0 0x7f3f28078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f30006fd0 tx=0x7f3f30008040 comp rx=0 tx=0).stop 2024-05-08T10:24:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 msgr2=0x7f3f3c1f6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 0x7f3f3c1f6160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00ce40 tx=0x7f3f2c00a660 comp rx=0 tx=0).stop 2024-05-08T10:24:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 shutdown_connections 2024-05-08T10:24:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f3c162ea0 0x7f3f3c0d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f3c148e20 0x7f3f3c0d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f280762d0 0x7f3f28078790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 --2- 172.21.15.143:0/743236911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f3c0b6910 0x7f3f3c1f6160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 >> 172.21.15.143:0/743236911 conn(0x7f3f3c0706c0 msgr2=0x7f3f3c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 shutdown_connections 2024-05-08T10:24:31.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.214+0000 7f3f4350a640 1 -- 172.21.15.143:0/743236911 wait complete. 2024-05-08T10:24:31.211 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T10:24:31.211 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:31.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.328+0000 7f285877f640 1 Processor -- start 2024-05-08T10:24:31.313 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.328+0000 7f285877f640 1 -- start start 2024-05-08T10:24:31.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f285877f640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2850154150 0x7f285006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f285877f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2850154530 con 0x7f28500aec00 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f285877f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2850073440 con 0x7f285006ee70 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f285877f640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f285015e190 con 0x7f2850154150 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2856d1c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f28500aec00 0x7f28500af000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33042/0 (socket says 172.21.15.143:33042) 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2856d1c640 1 -- 172.21.15.143:0/2758079332 learned_addr learned my addr 172.21.15.143:0/2758079332 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730124926 0 0) 0x7f2848001490 con 0x7f28500aec00 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f283c003520 con 0x7f28500aec00 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f285651b640 1 --2- 172.21.15.143:0/2758079332 >> v2:172.21.15.163:3300/0 conn(0x7f2850154150 0x7f285006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2810870558 0 0) 0x7f283c003520 con 0x7f28500aec00 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 >> v2:172.21.15.163:3300/0 conn(0x7f2850154150 msgr2=0x7f285006e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 --2- 172.21.15.143:0/2758079332 >> v2:172.21.15.163:3300/0 conn(0x7f2850154150 0x7f285006e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 >> v1:172.21.15.163:6789/0 conn(0x7f285006ee70 legacy=0x7f285015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285015e470 con 0x7f28500aec00 2024-05-08T10:24:31.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f2848001c40 con 0x7f28500aec00 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 >> v1:172.21.15.143:6789/0 conn(0x7f28500aec00 legacy=0x7f28500af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f283c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f283c004800 0x7f283c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f283c005210 0x7f283c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f285015e190 con 0x7f283c003a00 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f283c00c160 con 0x7f283c004800 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.329+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f283c00c360 con 0x7f283c005210 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.330+0000 7f285651b640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f283c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.330+0000 7f2855d1a640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f283c004800 0x7f283c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.330+0000 7f2856d1c640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f283c005210 0x7f283c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.330+0000 7f285651b640 1 -- 172.21.15.143:0/2758079332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f283c005210 msgr2=0x7f283c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.330+0000 7f285651b640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f283c005210 0x7f283c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.330+0000 7f285651b640 1 -- 172.21.15.143:0/2758079332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f283c004800 msgr2=0x7f283c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.330+0000 7f285651b640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f283c004800 0x7f283c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.330+0000 7f2856d1c640 1 -- 172.21.15.143:0/2758079332 reap_dead start 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.330+0000 7f285651b640 1 -- 172.21.15.143:0/2758079332 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c003520 con 0x7f283c003a00 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f285651b640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f283c003e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f284c00ba30 tx=0x7f283c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555b9bf80d4c5bd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c030070 con 0x7f283c003a00 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c02ae00 con 0x7f283c003a00 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f2855519640 1 -- 172.21.15.143:0/2758079332 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c00b600 con 0x7f283c003a00 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f285877f640 1 -- 172.21.15.143:0/2758079332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 msgr2=0x7f283c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f285877f640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f283c003e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f284c00ba30 tx=0x7f283c005830 comp rx=0 tx=0).stop 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f285877f640 1 -- 172.21.15.143:0/2758079332 shutdown_connections 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f285877f640 1 --2- 172.21.15.143:0/2758079332 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f283c003e20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f285877f640 1 -- 172.21.15.143:0/2758079332 >> 172.21.15.143:0/2758079332 conn(0x7f285006c500 msgr2=0x7f285006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:31.319 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f285877f640 1 -- 172.21.15.143:0/2758079332 shutdown_connections 2024-05-08T10:24:31.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.331+0000 7f285877f640 1 -- 172.21.15.143:0/2758079332 wait complete. 2024-05-08T10:24:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.332+0000 7f285877f640 1 Processor -- start 2024-05-08T10:24:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.332+0000 7f285877f640 1 -- start start 2024-05-08T10:24:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.333+0000 7f285877f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f2850148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.333+0000 7f285877f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28500b30c0 0x7f285009e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.333+0000 7f285877f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f285009e7e0 0x7f285009b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.333+0000 7f285877f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f28500ae4b0 con 0x7f283c003a00 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.333+0000 7f285877f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f28500ae330 con 0x7f285009e7e0 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.333+0000 7f285877f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f285006e930 con 0x7f28500b30c0 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.333+0000 7f285651b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f2850148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.333+0000 7f285651b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f2850148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39148/0 (socket says 172.21.15.143:39148) 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.333+0000 7f285651b640 1 -- 172.21.15.143:0/2208699927 learned_addr learned my addr 172.21.15.143:0/2208699927 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f285651b640 1 -- 172.21.15.143:0/2208699927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28500b30c0 msgr2=0x7f285009e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f285651b640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28500b30c0 0x7f285009e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f285651b640 1 -- 172.21.15.143:0/2208699927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f285009e7e0 msgr2=0x7f285009b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f285651b640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f285009e7e0 0x7f285009b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f285651b640 1 -- 172.21.15.143:0/2208699927 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500b1d40 con 0x7f283c003a00 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f285651b640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f2850148530 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f284c00bb50 tx=0x7f284c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:31.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f2846ffd640 1 -- 172.21.15.143:0/2208699927 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c042030 con 0x7f283c003a00 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f2846ffd640 1 -- 172.21.15.143:0/2208699927 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c02ac00 con 0x7f283c003a00 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28500b2020 con 0x7f283c003a00 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f2846ffd640 1 -- 172.21.15.143:0/2208699927 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c00b600 con 0x7f283c003a00 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.334+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28500b25e0 con 0x7f283c003a00 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.335+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f285006a550 con 0x7f283c003a00 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.335+0000 7f2846ffd640 1 -- 172.21.15.143:0/2208699927 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f284c045070 con 0x7f283c003a00 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.336+0000 7f2846ffd640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28340762d0 0x7f2834078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.336+0000 7f2846ffd640 1 -- 172.21.15.143:0/2208699927 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f284c0b7c50 con 0x7f283c003a00 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.336+0000 7f2855d1a640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28340762d0 0x7f2834078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.336+0000 7f2855d1a640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28340762d0 0x7f2834078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2840007850 tx=0x7f28400077e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:31.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.340+0000 7f2846ffd640 1 -- 172.21.15.143:0/2208699927 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f284c0bd020 con 0x7f283c003a00 2024-05-08T10:24:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.560+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2850072d40 con 0x7f283c003a00 2024-05-08T10:24:31.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.560+0000 7f2846ffd640 1 -- 172.21.15.143:0/2208699927 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5190 (secure 0 0 0) 0x7f284c0815b0 con 0x7f283c003a00 2024-05-08T10:24:31.547 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:31.547 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2519238209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2519238209},{"type":"v1","addr":"172.21.15.163:6834","nonce":2519238209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/420423244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":420423244},{"type":"v1","addr":"172.21.15.163:6835","nonce":420423244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4794,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2143046617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2143046617},{"type":"v1","addr":"172.21.15.143:6836","nonce":2143046617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:24:28.550393+0000","modified":"2024-05-08T10:24:30.548210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4797},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4797":{"gid":4797,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3656674830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3656674830},{"type":"v1","addr":"172.21.15.143:6837","nonce":3656674830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4797,"qdb_cluster":[4797]},"id":2}]} 2024-05-08T10:24:31.548 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 13 2024-05-08T10:24:31.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28340762d0 msgr2=0x7f2834078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28340762d0 0x7f2834078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2840007850 tx=0x7f28400077e0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.548 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 msgr2=0x7f2850148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f2850148530 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f284c00bb50 tx=0x7f284c004730 comp rx=0 tx=0).stop 2024-05-08T10:24:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 shutdown_connections 2024-05-08T10:24:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f285009e7e0 0x7f285009b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28500b30c0 0x7f285009e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28340762d0 0x7f2834078790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 --2- 172.21.15.143:0/2208699927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f283c003a00 0x7f2850148530 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 >> 172.21.15.143:0/2208699927 conn(0x7f285006c500 msgr2=0x7f285015fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 shutdown_connections 2024-05-08T10:24:31.549 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.563+0000 7f285877f640 1 -- 172.21.15.143:0/2208699927 wait complete. 2024-05-08T10:24:31.559 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:31.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.674+0000 7ffbfa55f640 1 Processor -- start 2024-05-08T10:24:31.659 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.674+0000 7ffbfa55f640 1 -- start start 2024-05-08T10:24:31.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbfa55f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffbf40705f0 0x7ffbf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbfa55f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 0x7ffbf40b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbfa55f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbf40b0560 con 0x7ffbf41493c0 2024-05-08T10:24:31.660 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbfa55f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf40b0340 con 0x7ffbf40705f0 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbfa55f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf406dcc0 con 0x7ffbf406d870 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbf37fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffbf40705f0 0x7ffbf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbf3fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ffbf41493c0 0x7ffbf40afc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33052/0 (socket says 172.21.15.143:33052) 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbf3fff640 1 -- 172.21.15.143:0/2648612621 learned_addr learned my addr 172.21.15.143:0/2648612621 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbf8afc640 1 --2- 172.21.15.143:0/2648612621 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 0x7ffbf40b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbf37fe640 1 -- 172.21.15.143:0/2648612621 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 msgr2=0x7ffbf40b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbf37fe640 1 --2- 172.21.15.143:0/2648612621 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 0x7ffbf40b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbf37fe640 1 -- 172.21.15.143:0/2648612621 >> v1:172.21.15.143:6789/0 conn(0x7ffbf41493c0 legacy=0x7ffbf40afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbf37fe640 1 -- 172.21.15.143:0/2648612621 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf40b0840 con 0x7ffbf40705f0 2024-05-08T10:24:31.661 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.675+0000 7ffbf2ffd640 1 -- 172.21.15.143:0/2648612621 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412570699 0 0) 0x7ffbf40b0560 con 0x7ffbf41493c0 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.676+0000 7ffbf37fe640 1 --2- 172.21.15.143:0/2648612621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf40705f0 0x7ffbf406d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80097a0 tx=0x7ffbe802a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9af5d01c9633b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.676+0000 7ffbf2ffd640 1 -- 172.21.15.143:0/2648612621 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8037070 con 0x7ffbf40705f0 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.676+0000 7ffbf2ffd640 1 -- 172.21.15.143:0/2648612621 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe802ae30 con 0x7ffbf40705f0 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.676+0000 7ffbf2ffd640 1 -- 172.21.15.143:0/2648612621 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8032640 con 0x7ffbf40705f0 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.676+0000 7ffbfa55f640 1 -- 172.21.15.143:0/2648612621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf40705f0 msgr2=0x7ffbf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.676+0000 7ffbfa55f640 1 --2- 172.21.15.143:0/2648612621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf40705f0 0x7ffbf406d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80097a0 tx=0x7ffbe802a0e0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.677+0000 7ffbfa55f640 1 -- 172.21.15.143:0/2648612621 shutdown_connections 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.677+0000 7ffbfa55f640 1 --2- 172.21.15.143:0/2648612621 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 0x7ffbf40b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.677+0000 7ffbfa55f640 1 --2- 172.21.15.143:0/2648612621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf40705f0 0x7ffbf406d330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.677+0000 7ffbfa55f640 1 -- 172.21.15.143:0/2648612621 >> 172.21.15.143:0/2648612621 conn(0x7ffbf4072ba0 msgr2=0x7ffbf4072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.677+0000 7ffbfa55f640 1 -- 172.21.15.143:0/2648612621 shutdown_connections 2024-05-08T10:24:31.663 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.677+0000 7ffbfa55f640 1 -- 172.21.15.143:0/2648612621 wait complete. 2024-05-08T10:24:31.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.678+0000 7ffbfa55f640 1 Processor -- start 2024-05-08T10:24:31.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.678+0000 7ffbfa55f640 1 -- start start 2024-05-08T10:24:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbfa55f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 0x7ffbf415c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbfa55f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbf40705f0 0x7ffbf415ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbfa55f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf41493c0 0x7ffbf4145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbfa55f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf40b0e00 con 0x7ffbf41493c0 2024-05-08T10:24:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbfa55f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf415fde0 con 0x7ffbf40705f0 2024-05-08T10:24:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbfa55f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf40b51f0 con 0x7ffbf406d870 2024-05-08T10:24:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf8afc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf41493c0 0x7ffbf4145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf8afc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf41493c0 0x7ffbf4145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39168/0 (socket says 172.21.15.143:39168) 2024-05-08T10:24:31.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf8afc640 1 -- 172.21.15.143:0/3947322213 learned_addr learned my addr 172.21.15.143:0/3947322213 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf3fff640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 0x7ffbf415c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf37fe640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbf40705f0 0x7ffbf415ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf8afc640 1 -- 172.21.15.143:0/3947322213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 msgr2=0x7ffbf415c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf8afc640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 0x7ffbf415c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf8afc640 1 -- 172.21.15.143:0/3947322213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbf40705f0 msgr2=0x7ffbf415ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf8afc640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbf40705f0 0x7ffbf415ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf8afc640 1 -- 172.21.15.143:0/3947322213 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf415c7f0 con 0x7ffbf41493c0 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf8afc640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf41493c0 0x7ffbf4145490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffbec007e40 tx=0x7ffbec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf0ff9640 1 -- 172.21.15.143:0/3947322213 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbec014620 con 0x7ffbf41493c0 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf0ff9640 1 -- 172.21.15.143:0/3947322213 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbec019070 con 0x7ffbf41493c0 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbf0ff9640 1 -- 172.21.15.143:0/3947322213 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbec014a20 con 0x7ffbf41493c0 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf413b4a0 con 0x7ffbf41493c0 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.679+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf4160d30 con 0x7ffbf41493c0 2024-05-08T10:24:31.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.680+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf4160f00 con 0x7ffbf41493c0 2024-05-08T10:24:31.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.681+0000 7ffbf0ff9640 1 -- 172.21.15.143:0/3947322213 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffbec014bc0 con 0x7ffbf41493c0 2024-05-08T10:24:31.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.681+0000 7ffbf0ff9640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffbe00762d0 0x7ffbe0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.681+0000 7ffbf3fff640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffbe00762d0 0x7ffbe0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.681+0000 7ffbf0ff9640 1 -- 172.21.15.143:0/3947322213 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ffbec097ef0 con 0x7ffbf41493c0 2024-05-08T10:24:31.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.682+0000 7ffbf3fff640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffbe00762d0 0x7ffbe0078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4000f60 tx=0x7ffbe4007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:31.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.686+0000 7ffbf0ff9640 1 -- 172.21.15.143:0/3947322213 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffbec061850 con 0x7ffbf41493c0 2024-05-08T10:24:31.851 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.866+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbf415fa60 con 0x7ffbf41493c0 2024-05-08T10:24:31.852 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.867+0000 7ffbf0ff9640 1 -- 172.21.15.143:0/3947322213 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16705 (secure 0 0 0) 0x7ffbec061150 con 0x7ffbf41493c0 2024-05-08T10:24:31.853 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:31.853 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":31,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:24:30.198247+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:24:26.325731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:24:27.512735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffbe00762d0 msgr2=0x7ffbe0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffbe00762d0 0x7ffbe0078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4000f60 tx=0x7ffbe4007c00 comp rx=0 tx=0).stop 2024-05-08T10:24:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf41493c0 msgr2=0x7ffbf4145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf41493c0 0x7ffbf4145490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffbec007e40 tx=0x7ffbec00e4b0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 shutdown_connections 2024-05-08T10:24:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ffbe00762d0 0x7ffbe0078790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffbf41493c0 0x7ffbf4145490 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffbf40705f0 0x7ffbf415ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 --2- 172.21.15.143:0/3947322213 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffbf406d870 0x7ffbf415c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 >> 172.21.15.143:0/3947322213 conn(0x7ffbf4072ba0 msgr2=0x7ffbf40b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:31.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 shutdown_connections 2024-05-08T10:24:31.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.870+0000 7ffbfa55f640 1 -- 172.21.15.143:0/3947322213 wait complete. 2024-05-08T10:24:31.866 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T10:24:31.866 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:31.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.981+0000 7f0c97ac8640 1 Processor -- start 2024-05-08T10:24:31.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.981+0000 7f0c97ac8640 1 -- start start 2024-05-08T10:24:31.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c97ac8640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0c9015c150 0x7f0c900702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c97ac8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 0x7f0c900b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c97ac8640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9015c530 con 0x7f0c90070d80 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c97ac8640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f0c900b4fa0 con 0x7f0c9015c150 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c97ac8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0c900b0790 con 0x7f0c900b4340 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c95864640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0c9015c150 0x7f0c900702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c96065640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 0x7f0c900b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c95063640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f0c90070d80 0x7f0c900b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:58844/0 (socket says 172.21.15.143:58844) 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c95063640 1 -- 172.21.15.143:0/3028814779 learned_addr learned my addr 172.21.15.143:0/3028814779 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c95864640 1 -- 172.21.15.143:0/3028814779 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 msgr2=0x7f0c900b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c95864640 1 --2- 172.21.15.143:0/3028814779 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 0x7f0c900b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c95864640 1 -- 172.21.15.143:0/3028814779 >> v1:172.21.15.163:6789/0 conn(0x7f0c90070d80 legacy=0x7f0c900b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c95864640 1 -- 172.21.15.143:0/3028814779 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c900b0a70 con 0x7f0c9015c150 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c94862640 1 -- 172.21.15.143:0/3028814779 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672771156 0 0) 0x7f0c9015c530 con 0x7f0c90070d80 2024-05-08T10:24:31.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.982+0000 7f0c96065640 1 --2- 172.21.15.143:0/3028814779 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 0x7f0c900b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.983+0000 7f0c95864640 1 --2- 172.21.15.143:0/3028814779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c9015c150 0x7f0c900702c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0c800097a0 tx=0x7f0c8002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3cb7dcd9a354b84 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.983+0000 7f0c94862640 1 -- 172.21.15.143:0/3028814779 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80037070 con 0x7f0c9015c150 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.983+0000 7f0c94862640 1 -- 172.21.15.143:0/3028814779 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c80032440 con 0x7f0c9015c150 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.983+0000 7f0c94862640 1 -- 172.21.15.143:0/3028814779 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80032810 con 0x7f0c9015c150 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.984+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3028814779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c9015c150 msgr2=0x7f0c900702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.984+0000 7f0c97ac8640 1 --2- 172.21.15.143:0/3028814779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c9015c150 0x7f0c900702c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0c800097a0 tx=0x7f0c8002a180 comp rx=0 tx=0).stop 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.984+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3028814779 shutdown_connections 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.984+0000 7f0c97ac8640 1 --2- 172.21.15.143:0/3028814779 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 0x7f0c900b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.984+0000 7f0c97ac8640 1 --2- 172.21.15.143:0/3028814779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c9015c150 0x7f0c900702c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.984+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3028814779 >> 172.21.15.143:0/3028814779 conn(0x7f0c9006d430 msgr2=0x7f0c9006d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:31.970 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.984+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3028814779 shutdown_connections 2024-05-08T10:24:31.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.984+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3028814779 wait complete. 2024-05-08T10:24:31.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.985+0000 7f0c97ac8640 1 Processor -- start 2024-05-08T10:24:31.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.985+0000 7f0c97ac8640 1 -- start start 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c97ac8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c90070d80 0x7f0c9014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c97ac8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 0x7f0c9015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c97ac8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9015c150 0x7f0c9015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c97ac8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0c90070800 con 0x7f0c9015c150 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c97ac8640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0c900b51f0 con 0x7f0c90070d80 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c97ac8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f0c900b5c50 con 0x7f0c900b4340 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c96065640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9015c150 0x7f0c9015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c96065640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9015c150 0x7f0c9015a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39178/0 (socket says 172.21.15.143:39178) 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c96065640 1 -- 172.21.15.143:0/3481701338 learned_addr learned my addr 172.21.15.143:0/3481701338 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c95864640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c90070d80 0x7f0c9014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c95063640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 0x7f0c9015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c96065640 1 -- 172.21.15.143:0/3481701338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 msgr2=0x7f0c9015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c96065640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 0x7f0c9015a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c96065640 1 -- 172.21.15.143:0/3481701338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c90070d80 msgr2=0x7f0c9014e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c96065640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c90070d80 0x7f0c9014e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c96065640 1 -- 172.21.15.143:0/3481701338 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c901546b0 con 0x7f0c9015c150 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c96065640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9015c150 0x7f0c9015a7d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800ef90 tx=0x7f0c88009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c8e7fc640 1 -- 172.21.15.143:0/3481701338 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88018020 con 0x7f0c9015c150 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c8e7fc640 1 -- 172.21.15.143:0/3481701338 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c88014480 con 0x7f0c9015c150 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c90154990 con 0x7f0c9015c150 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.986+0000 7f0c8e7fc640 1 -- 172.21.15.143:0/3481701338 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88014870 con 0x7f0c9015c150 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.987+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c90154f50 con 0x7f0c9015c150 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.987+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c9006a550 con 0x7f0c9015c150 2024-05-08T10:24:31.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.988+0000 7f0c8e7fc640 1 -- 172.21.15.143:0/3481701338 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c88005d10 con 0x7f0c9015c150 2024-05-08T10:24:31.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.988+0000 7f0c8e7fc640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0c7c0762d0 0x7f0c7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:31.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.988+0000 7f0c8e7fc640 1 -- 172.21.15.143:0/3481701338 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0c880981d0 con 0x7f0c9015c150 2024-05-08T10:24:31.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.988+0000 7f0c95864640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0c7c0762d0 0x7f0c7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:31.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.989+0000 7f0c95864640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0c7c0762d0 0x7f0c7c078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0c80034000 tx=0x7f0c8002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:31.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:31.993+0000 7f0c8e7fc640 1 -- 172.21.15.143:0/3481701338 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0c88022030 con 0x7f0c9015c150 2024-05-08T10:24:32.155 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.170+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0c90070460 con 0x7f0c7c0762d0 2024-05-08T10:24:32.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.175+0000 7f0c8e7fc640 1 -- 172.21.15.143:0/3481701338 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239828 (secure 0 0 0) 0x7f0c90070460 con 0x7f0c7c0762d0 2024-05-08T10:24:32.163 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:32.164 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:32.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0c7c0762d0 msgr2=0x7f0c7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0c7c0762d0 0x7f0c7c078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0c80034000 tx=0x7f0c8002e000 comp rx=0 tx=0).stop 2024-05-08T10:24:32.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9015c150 msgr2=0x7f0c9015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9015c150 0x7f0c9015a7d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800ef90 tx=0x7f0c88009f90 comp rx=0 tx=0).stop 2024-05-08T10:24:32.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 shutdown_connections 2024-05-08T10:24:32.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f0c7c0762d0 0x7f0c7c078790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9015c150 0x7f0c9015a7d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0c900b4340 0x7f0c9015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 --2- 172.21.15.143:0/3481701338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c90070d80 0x7f0c9014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 >> 172.21.15.143:0/3481701338 conn(0x7f0c9006d430 msgr2=0x7f0c900b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:32.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 shutdown_connections 2024-05-08T10:24:32.167 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.178+0000 7f0c97ac8640 1 -- 172.21.15.143:0/3481701338 wait complete. 2024-05-08T10:24:32.174 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-05-08T10:24:30.532254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219764,"kb_used_data":3580,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754956,"statfs":{"total":773094113280,"available":772869074944,"internally_reserved":0,"allocated":3665920,"data_stored":2093191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000632"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190662+0000","last_change":"2024-05-08T10:24:27.190662+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190662+0000","last_undegraded":"2024-05-08T10:24:27.190662+0000","last_fullsized":"2024-05-08T10:24:27.190662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474811+0000","last_change":"2024-05-08T10:24:27.474811+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474811+0000","last_undegraded":"2024-05-08T10:24:27.474811+0000","last_fullsized":"2024-05-08T10:24:27.474811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188359+0000","last_change":"2024-05-08T10:24:27.188359+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188359+0000","last_undegraded":"2024-05-08T10:24:27.188359+0000","last_fullsized":"2024-05-08T10:24:27.188359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187576+0000","last_change":"2024-05-08T10:24:27.187576+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187576+0000","last_undegraded":"2024-05-08T10:24:27.187576+0000","last_fullsized":"2024-05-08T10:24:27.187576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.189182+0000","last_change":"2024-05-08T10:24:27.189182+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.189182+0000","last_undegraded":"2024-05-08T10:24:27.189182+0000","last_fullsized":"2024-05-08T10:24:27.189182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188526+0000","last_change":"2024-05-08T10:24:27.188526+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188526+0000","last_undegraded":"2024-05-08T10:24:27.188526+0000","last_fullsized":"2024-05-08T10:24:27.188526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188131+0000","last_change":"2024-05-08T10:24:27.188131+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188131+0000","last_undegraded":"2024-05-08T10:24:27.188131+0000","last_fullsized":"2024-05-08T10:24:27.188131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188200+0000","last_change":"2024-05-08T10:24:27.188200+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188200+0000","last_undegraded":"2024-05-08T10:24:27.188200+0000","last_fullsized":"2024-05-08T10:24:27.188200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187771+0000","last_change":"2024-05-08T10:24:27.187771+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187771+0000","last_undegraded":"2024-05-08T10:24:27.187771+0000","last_fullsized":"2024-05-08T10:24:27.187771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474365+0000","last_change":"2024-05-08T10:24:27.474365+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474365+0000","last_undegraded":"2024-05-08T10:24:27.474365+0000","last_fullsized":"2024-05-08T10:24:27.474365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191825+0000","last_change":"2024-05-08T10:24:27.191825+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191825+0000","last_undegraded":"2024-05-08T10:24:27.191825+0000","last_fullsized":"2024-05-08T10:24:27.191825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187783+0000","last_change":"2024-05-08T10:24:27.187783+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187783+0000","last_undegraded":"2024-05-08T10:24:27.187783+0000","last_fullsized":"2024-05-08T10:24:27.187783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188749+0000","last_change":"2024-05-08T10:24:27.188749+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188749+0000","last_undegraded":"2024-05-08T10:24:27.188749+0000","last_fullsized":"2024-05-08T10:24:27.188749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191538+0000","last_change":"2024-05-08T10:24:27.191538+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191538+0000","last_undegraded":"2024-05-08T10:24:27.191538+0000","last_fullsized":"2024-05-08T10:24:27.191538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187641+0000","last_change":"2024-05-08T10:24:27.187641+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187641+0000","last_undegraded":"2024-05-08T10:24:27.187641+0000","last_fullsized":"2024-05-08T10:24:27.187641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187628+0000","last_change":"2024-05-08T10:24:27.187628+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187628+0000","last_undegraded":"2024-05-08T10:24:27.187628+0000","last_fullsized":"2024-05-08T10:24:27.187628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191576+0000","last_change":"2024-05-08T10:24:27.191576+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191576+0000","last_undegraded":"2024-05-08T10:24:27.191576+0000","last_fullsized":"2024-05-08T10:24:27.191576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188195+0000","last_change":"2024-05-08T10:24:27.188195+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188195+0000","last_undegraded":"2024-05-08T10:24:27.188195+0000","last_fullsized":"2024-05-08T10:24:27.188195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187962+0000","last_change":"2024-05-08T10:24:27.187962+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187962+0000","last_undegraded":"2024-05-08T10:24:27.187962+0000","last_fullsized":"2024-05-08T10:24:27.187962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188076+0000","last_change":"2024-05-08T10:24:27.188076+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188076+0000","last_undegraded":"2024-05-08T10:24:27.188076+0000","last_fullsized":"2024-05-08T10:24:27.188076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474375+0000","last_change":"2024-05-08T10:24:27.474375+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474375+0000","last_undegraded":"2024-05-08T10:24:27.474375+0000","last_fullsized":"2024-05-08T10:24:27.474375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190652+0000","last_change":"2024-05-08T10:24:27.190652+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190652+0000","last_undegraded":"2024-05-08T10:24:27.190652+0000","last_fullsized":"2024-05-08T10:24:27.190652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.189023+0000","last_change":"2024-05-08T10:24:27.189023+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.189023+0000","last_undegraded":"2024-05-08T10:24:27.189023+0000","last_fullsized":"2024-05-08T10:24:27.189023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191806+0000","last_change":"2024-05-08T10:24:27.191806+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191806+0000","last_undegraded":"2024-05-08T10:24:27.191806+0000","last_fullsized":"2024-05-08T10:24:27.191806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191063+0000","last_change":"2024-05-08T10:24:27.191063+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191063+0000","last_undegraded":"2024-05-08T10:24:27.191063+0000","last_fullsized":"2024-05-08T10:24:27.191063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.473918+0000","last_change":"2024-05-08T10:24:27.473918+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.473918+0000","last_undegraded":"2024-05-08T10:24:27.473918+0000","last_fullsized":"2024-05-08T10:24:27.473918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191014+0000","last_change":"2024-05-08T10:24:27.191014+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191014+0000","last_undegraded":"2024-05-08T10:24:27.191014+0000","last_fullsized":"2024-05-08T10:24:27.191014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.473922+0000","last_change":"2024-05-08T10:24:27.473922+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.473922+0000","last_undegraded":"2024-05-08T10:24:27.473922+0000","last_fullsized":"2024-05-08T10:24:27.473922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191006+0000","last_change":"2024-05-08T10:24:27.191006+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191006+0000","last_undegraded":"2024-05-08T10:24:27.191006+0000","last_fullsized":"2024-05-08T10:24:27.191006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187962+0000","last_change":"2024-05-08T10:24:27.187962+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187962+0000","last_undegraded":"2024-05-08T10:24:27.187962+0000","last_fullsized":"2024-05-08T10:24:27.187962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.186511+0000","last_change":"2024-05-08T10:24:27.186511+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.186511+0000","last_undegraded":"2024-05-08T10:24:27.186511+0000","last_fullsized":"2024-05-08T10:24:27.186511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190715+0000","last_change":"2024-05-08T10:24:27.190715+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190715+0000","last_undegraded":"2024-05-08T10:24:27.190715+0000","last_fullsized":"2024-05-08T10:24:27.190715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-08T10:24:27.190076+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:24:27.190076+0000","last_peered":"2024-05-08T10:24:27.190076+0000","last_clean":"2024-05-08T10:24:27.190076+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:27.190076+0000","last_undegraded":"2024-05-08T10:24:27.190076+0000","last_fullsized":"2024-05-08T10:24:27.190076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":699335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:32.179 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:32.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.329+0000 7fb053285640 1 Processor -- start 2024-05-08T10:24:32.314 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.329+0000 7fb053285640 1 -- start start 2024-05-08T10:24:32.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.330+0000 7fb053285640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb04c160d50 0x7fb04c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.330+0000 7fb053285640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb04c0d0e40 0x7fb04c15cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.316 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.330+0000 7fb053285640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb04c0b5230 con 0x7fb04c06d870 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.330+0000 7fb053285640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb04c0d14b0 con 0x7fb04c160d50 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.330+0000 7fb053285640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb04c0b54c0 con 0x7fb04c0d0e40 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.330+0000 7fb051021640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb04c160d50 0x7fb04c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.330+0000 7fb050820640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb04c06d870 0x7fb04c0d0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33064/0 (socket says 172.21.15.143:33064) 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.330+0000 7fb051021640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb04c160d50 0x7fb04c06d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39180/0 (socket says 172.21.15.143:39180) 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.330+0000 7fb050820640 1 -- 172.21.15.143:0/1435391322 learned_addr learned my addr 172.21.15.143:0/1435391322 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.331+0000 7fb051021640 1 -- 172.21.15.143:0/1435391322 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb04c0d0e40 msgr2=0x7fb04c15cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.331+0000 7fb051822640 1 --2- 172.21.15.143:0/1435391322 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb04c0d0e40 0x7fb04c15cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.331+0000 7fb04bfff640 1 -- 172.21.15.143:0/1435391322 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071240085 0 0) 0x7fb04c0b5230 con 0x7fb04c06d870 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.331+0000 7fb051021640 1 --2- 172.21.15.143:0/1435391322 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb04c0d0e40 0x7fb04c15cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.331+0000 7fb051021640 1 -- 172.21.15.143:0/1435391322 >> v1:172.21.15.143:6789/0 conn(0x7fb04c06d870 legacy=0x7fb04c0d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.331+0000 7fb051021640 1 -- 172.21.15.143:0/1435391322 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c0b57a0 con 0x7fb04c160d50 2024-05-08T10:24:32.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.331+0000 7fb051021640 1 --2- 172.21.15.143:0/1435391322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c160d50 0x7fb04c06d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0097a0 tx=0x7fb03c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291e7dfffd4b197a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:32.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.331+0000 7fb04bfff640 1 -- 172.21.15.143:0/1435391322 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c037070 con 0x7fb04c160d50 2024-05-08T10:24:32.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.331+0000 7fb04bfff640 1 -- 172.21.15.143:0/1435391322 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb03c032440 con 0x7fb04c160d50 2024-05-08T10:24:32.318 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.332+0000 7fb04bfff640 1 -- 172.21.15.143:0/1435391322 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c032810 con 0x7fb04c160d50 2024-05-08T10:24:32.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.332+0000 7fb053285640 1 -- 172.21.15.143:0/1435391322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c160d50 msgr2=0x7fb04c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.332+0000 7fb053285640 1 --2- 172.21.15.143:0/1435391322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c160d50 0x7fb04c06d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0097a0 tx=0x7fb03c02a180 comp rx=0 tx=0).stop 2024-05-08T10:24:32.320 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.332+0000 7fb053285640 1 -- 172.21.15.143:0/1435391322 shutdown_connections 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.332+0000 7fb053285640 1 --2- 172.21.15.143:0/1435391322 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb04c0d0e40 0x7fb04c15cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.332+0000 7fb053285640 1 --2- 172.21.15.143:0/1435391322 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c160d50 0x7fb04c06d330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.332+0000 7fb053285640 1 -- 172.21.15.143:0/1435391322 >> 172.21.15.143:0/1435391322 conn(0x7fb04c072ba0 msgr2=0x7fb04c072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.332+0000 7fb053285640 1 -- 172.21.15.143:0/1435391322 shutdown_connections 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.332+0000 7fb053285640 1 -- 172.21.15.143:0/1435391322 wait complete. 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.333+0000 7fb053285640 1 Processor -- start 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.333+0000 7fb053285640 1 -- start start 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb053285640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb04c06d870 0x7fb04c06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb053285640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c0d0e40 0x7fb04c142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb053285640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb04c160d50 0x7fb04c145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb053285640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c0b6120 con 0x7fb04c0d0e40 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb053285640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c0b5fa0 con 0x7fb04c160d50 2024-05-08T10:24:32.321 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb053285640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb04c15d080 con 0x7fb04c06d870 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb050820640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c0d0e40 0x7fb04c142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb050820640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c0d0e40 0x7fb04c142ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39182/0 (socket says 172.21.15.143:39182) 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb050820640 1 -- 172.21.15.143:0/787915671 learned_addr learned my addr 172.21.15.143:0/787915671 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb050820640 1 -- 172.21.15.143:0/787915671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb04c06d870 msgr2=0x7fb04c06f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb050820640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb04c06d870 0x7fb04c06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb050820640 1 -- 172.21.15.143:0/787915671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb04c160d50 msgr2=0x7fb04c145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb050820640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb04c160d50 0x7fb04c145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb050820640 1 -- 172.21.15.143:0/787915671 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c146280 con 0x7fb04c0d0e40 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.334+0000 7fb050820640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c0d0e40 0x7fb04c142ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb04000c4c0 tx=0x7fb04000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.335+0000 7fb049ffb640 1 -- 172.21.15.143:0/787915671 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040018070 con 0x7fb04c0d0e40 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.335+0000 7fb049ffb640 1 -- 172.21.15.143:0/787915671 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb040007500 con 0x7fb04c0d0e40 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.335+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04c145cc0 con 0x7fb04c0d0e40 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.335+0000 7fb049ffb640 1 -- 172.21.15.143:0/787915671 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040004a20 con 0x7fb04c0d0e40 2024-05-08T10:24:32.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.335+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04c1433f0 con 0x7fb04c0d0e40 2024-05-08T10:24:32.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.336+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb04c068920 con 0x7fb04c0d0e40 2024-05-08T10:24:32.323 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.337+0000 7fb049ffb640 1 -- 172.21.15.143:0/787915671 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb04001b070 con 0x7fb04c0d0e40 2024-05-08T10:24:32.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.337+0000 7fb049ffb640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb0380762d0 0x7fb038078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.337+0000 7fb049ffb640 1 -- 172.21.15.143:0/787915671 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb0400968e0 con 0x7fb04c0d0e40 2024-05-08T10:24:32.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.337+0000 7fb051021640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb0380762d0 0x7fb038078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.324 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.338+0000 7fb051021640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb0380762d0 0x7fb038078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb03c034000 tx=0x7fb03c02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:32.326 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.341+0000 7fb049ffb640 1 -- 172.21.15.143:0/787915671 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb0400602d0 con 0x7fb04c0d0e40 2024-05-08T10:24:32.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.520+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb04c0ce9f0 con 0x7fb0380762d0 2024-05-08T10:24:32.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.526+0000 7fb049ffb640 1 -- 172.21.15.143:0/787915671 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239828 (secure 0 0 0) 0x7fb04c0ce9f0 con 0x7fb0380762d0 2024-05-08T10:24:32.513 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:32.515 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb0380762d0 msgr2=0x7fb038078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb0380762d0 0x7fb038078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb03c034000 tx=0x7fb03c02c000 comp rx=0 tx=0).stop 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c0d0e40 msgr2=0x7fb04c142ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c0d0e40 0x7fb04c142ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb04000c4c0 tx=0x7fb04000c980 comp rx=0 tx=0).stop 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 shutdown_connections 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb04c160d50 0x7fb04c145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb0380762d0 0x7fb038078790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb04c0d0e40 0x7fb04c142ae0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 --2- 172.21.15.143:0/787915671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb04c06d870 0x7fb04c06f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 >> 172.21.15.143:0/787915671 conn(0x7fb04c072ba0 msgr2=0x7fb04c15d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 shutdown_connections 2024-05-08T10:24:32.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.529+0000 7fb053285640 1 -- 172.21.15.143:0/787915671 wait complete. 2024-05-08T10:24:32.526 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-05-08T10:24:30.532254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219764,"kb_used_data":3580,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754956,"statfs":{"total":773094113280,"available":772869074944,"internally_reserved":0,"allocated":3665920,"data_stored":2093191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000632"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190662+0000","last_change":"2024-05-08T10:24:27.190662+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190662+0000","last_undegraded":"2024-05-08T10:24:27.190662+0000","last_fullsized":"2024-05-08T10:24:27.190662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474811+0000","last_change":"2024-05-08T10:24:27.474811+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474811+0000","last_undegraded":"2024-05-08T10:24:27.474811+0000","last_fullsized":"2024-05-08T10:24:27.474811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188359+0000","last_change":"2024-05-08T10:24:27.188359+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188359+0000","last_undegraded":"2024-05-08T10:24:27.188359+0000","last_fullsized":"2024-05-08T10:24:27.188359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187576+0000","last_change":"2024-05-08T10:24:27.187576+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187576+0000","last_undegraded":"2024-05-08T10:24:27.187576+0000","last_fullsized":"2024-05-08T10:24:27.187576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.189182+0000","last_change":"2024-05-08T10:24:27.189182+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.189182+0000","last_undegraded":"2024-05-08T10:24:27.189182+0000","last_fullsized":"2024-05-08T10:24:27.189182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188526+0000","last_change":"2024-05-08T10:24:27.188526+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188526+0000","last_undegraded":"2024-05-08T10:24:27.188526+0000","last_fullsized":"2024-05-08T10:24:27.188526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188131+0000","last_change":"2024-05-08T10:24:27.188131+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188131+0000","last_undegraded":"2024-05-08T10:24:27.188131+0000","last_fullsized":"2024-05-08T10:24:27.188131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188200+0000","last_change":"2024-05-08T10:24:27.188200+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188200+0000","last_undegraded":"2024-05-08T10:24:27.188200+0000","last_fullsized":"2024-05-08T10:24:27.188200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187771+0000","last_change":"2024-05-08T10:24:27.187771+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187771+0000","last_undegraded":"2024-05-08T10:24:27.187771+0000","last_fullsized":"2024-05-08T10:24:27.187771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474365+0000","last_change":"2024-05-08T10:24:27.474365+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474365+0000","last_undegraded":"2024-05-08T10:24:27.474365+0000","last_fullsized":"2024-05-08T10:24:27.474365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191825+0000","last_change":"2024-05-08T10:24:27.191825+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191825+0000","last_undegraded":"2024-05-08T10:24:27.191825+0000","last_fullsized":"2024-05-08T10:24:27.191825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187783+0000","last_change":"2024-05-08T10:24:27.187783+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187783+0000","last_undegraded":"2024-05-08T10:24:27.187783+0000","last_fullsized":"2024-05-08T10:24:27.187783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188749+0000","last_change":"2024-05-08T10:24:27.188749+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188749+0000","last_undegraded":"2024-05-08T10:24:27.188749+0000","last_fullsized":"2024-05-08T10:24:27.188749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191538+0000","last_change":"2024-05-08T10:24:27.191538+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191538+0000","last_undegraded":"2024-05-08T10:24:27.191538+0000","last_fullsized":"2024-05-08T10:24:27.191538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187641+0000","last_change":"2024-05-08T10:24:27.187641+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187641+0000","last_undegraded":"2024-05-08T10:24:27.187641+0000","last_fullsized":"2024-05-08T10:24:27.187641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187628+0000","last_change":"2024-05-08T10:24:27.187628+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187628+0000","last_undegraded":"2024-05-08T10:24:27.187628+0000","last_fullsized":"2024-05-08T10:24:27.187628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191576+0000","last_change":"2024-05-08T10:24:27.191576+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191576+0000","last_undegraded":"2024-05-08T10:24:27.191576+0000","last_fullsized":"2024-05-08T10:24:27.191576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188195+0000","last_change":"2024-05-08T10:24:27.188195+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188195+0000","last_undegraded":"2024-05-08T10:24:27.188195+0000","last_fullsized":"2024-05-08T10:24:27.188195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187962+0000","last_change":"2024-05-08T10:24:27.187962+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187962+0000","last_undegraded":"2024-05-08T10:24:27.187962+0000","last_fullsized":"2024-05-08T10:24:27.187962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188076+0000","last_change":"2024-05-08T10:24:27.188076+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188076+0000","last_undegraded":"2024-05-08T10:24:27.188076+0000","last_fullsized":"2024-05-08T10:24:27.188076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474375+0000","last_change":"2024-05-08T10:24:27.474375+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474375+0000","last_undegraded":"2024-05-08T10:24:27.474375+0000","last_fullsized":"2024-05-08T10:24:27.474375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190652+0000","last_change":"2024-05-08T10:24:27.190652+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190652+0000","last_undegraded":"2024-05-08T10:24:27.190652+0000","last_fullsized":"2024-05-08T10:24:27.190652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.189023+0000","last_change":"2024-05-08T10:24:27.189023+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.189023+0000","last_undegraded":"2024-05-08T10:24:27.189023+0000","last_fullsized":"2024-05-08T10:24:27.189023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191806+0000","last_change":"2024-05-08T10:24:27.191806+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191806+0000","last_undegraded":"2024-05-08T10:24:27.191806+0000","last_fullsized":"2024-05-08T10:24:27.191806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191063+0000","last_change":"2024-05-08T10:24:27.191063+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191063+0000","last_undegraded":"2024-05-08T10:24:27.191063+0000","last_fullsized":"2024-05-08T10:24:27.191063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.473918+0000","last_change":"2024-05-08T10:24:27.473918+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.473918+0000","last_undegraded":"2024-05-08T10:24:27.473918+0000","last_fullsized":"2024-05-08T10:24:27.473918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191014+0000","last_change":"2024-05-08T10:24:27.191014+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191014+0000","last_undegraded":"2024-05-08T10:24:27.191014+0000","last_fullsized":"2024-05-08T10:24:27.191014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.473922+0000","last_change":"2024-05-08T10:24:27.473922+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.473922+0000","last_undegraded":"2024-05-08T10:24:27.473922+0000","last_fullsized":"2024-05-08T10:24:27.473922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191006+0000","last_change":"2024-05-08T10:24:27.191006+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191006+0000","last_undegraded":"2024-05-08T10:24:27.191006+0000","last_fullsized":"2024-05-08T10:24:27.191006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187962+0000","last_change":"2024-05-08T10:24:27.187962+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187962+0000","last_undegraded":"2024-05-08T10:24:27.187962+0000","last_fullsized":"2024-05-08T10:24:27.187962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.186511+0000","last_change":"2024-05-08T10:24:27.186511+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.186511+0000","last_undegraded":"2024-05-08T10:24:27.186511+0000","last_fullsized":"2024-05-08T10:24:27.186511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190715+0000","last_change":"2024-05-08T10:24:27.190715+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190715+0000","last_undegraded":"2024-05-08T10:24:27.190715+0000","last_fullsized":"2024-05-08T10:24:27.190715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-08T10:24:27.190076+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:24:27.190076+0000","last_peered":"2024-05-08T10:24:27.190076+0000","last_clean":"2024-05-08T10:24:27.190076+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:27.190076+0000","last_undegraded":"2024-05-08T10:24:27.190076+0000","last_fullsized":"2024-05-08T10:24:27.190076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":699335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:32.530 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:32.666 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.681+0000 7f7b8359e640 1 Processor -- start 2024-05-08T10:24:32.667 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.681+0000 7f7b8359e640 1 -- start start 2024-05-08T10:24:32.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.682+0000 7f7b8359e640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7b84142240 0x7f7b8406c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.682+0000 7f7b8359e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b8406c860 0x7f7b8415f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.668 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.682+0000 7f7b8359e640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b84162e70 con 0x7f7b84141e60 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.682+0000 7f7b8359e640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7b84071680 con 0x7f7b84142240 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.682+0000 7f7b8359e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7b841637a0 con 0x7f7b8406c860 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b82d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b8406c860 0x7f7b8415f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b81d9b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7b84142240 0x7f7b8406c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b8259c640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f7b84141e60 0x7f7b84070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:58854/0 (socket says 172.21.15.143:58854) 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b82d9d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b8406c860 0x7f7b8415f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:43284/0 (socket says 172.21.15.143:43284) 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b81d9b640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7b84142240 0x7f7b8406c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:53656/0 (socket says 172.21.15.143:53656) 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b8259c640 1 -- 172.21.15.143:0/2044619855 learned_addr learned my addr 172.21.15.143:0/2044619855 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b8159a640 1 -- 172.21.15.143:0/2044619855 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365640857 0 0) 0x7f7b84162e70 con 0x7f7b84141e60 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b8159a640 1 -- 172.21.15.143:0/2044619855 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b6c003520 con 0x7f7b84141e60 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b82d9d640 1 -- 172.21.15.143:0/2044619855 >> v2:172.21.15.163:3300/0 conn(0x7f7b84142240 msgr2=0x7f7b8406c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b82d9d640 1 --2- 172.21.15.143:0/2044619855 >> v2:172.21.15.163:3300/0 conn(0x7f7b84142240 0x7f7b8406c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b82d9d640 1 -- 172.21.15.143:0/2044619855 >> v1:172.21.15.163:6789/0 conn(0x7f7b84141e60 legacy=0x7f7b84070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.669 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b82d9d640 1 -- 172.21.15.143:0/2044619855 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b84163150 con 0x7f7b8406c860 2024-05-08T10:24:32.670 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.683+0000 7f7b81d9b640 1 --2- 172.21.15.143:0/2044619855 >> v2:172.21.15.163:3300/0 conn(0x7f7b84142240 0x7f7b8406c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:32.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.684+0000 7f7b82d9d640 1 --2- 172.21.15.143:0/2044619855 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b8406c860 0x7f7b8415f620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0097a0 tx=0x7f7b7c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7874d39c9d64f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:32.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.684+0000 7f7b8159a640 1 -- 172.21.15.143:0/2044619855 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c037070 con 0x7f7b8406c860 2024-05-08T10:24:32.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.684+0000 7f7b8159a640 1 -- 172.21.15.143:0/2044619855 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c032440 con 0x7f7b8406c860 2024-05-08T10:24:32.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.684+0000 7f7b8159a640 1 -- 172.21.15.143:0/2044619855 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c0327f0 con 0x7f7b8406c860 2024-05-08T10:24:32.671 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.685+0000 7f7b8359e640 1 -- 172.21.15.143:0/2044619855 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b8406c860 msgr2=0x7f7b8415f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.685+0000 7f7b8359e640 1 --2- 172.21.15.143:0/2044619855 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b8406c860 0x7f7b8415f620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0097a0 tx=0x7f7b7c02a180 comp rx=0 tx=0).stop 2024-05-08T10:24:32.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.685+0000 7f7b8359e640 1 -- 172.21.15.143:0/2044619855 shutdown_connections 2024-05-08T10:24:32.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.685+0000 7f7b8359e640 1 --2- 172.21.15.143:0/2044619855 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b8406c860 0x7f7b8415f620 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.685+0000 7f7b8359e640 1 --2- 172.21.15.143:0/2044619855 >> v2:172.21.15.163:3300/0 conn(0x7f7b84142240 0x7f7b8406c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.685+0000 7f7b8359e640 1 -- 172.21.15.143:0/2044619855 >> 172.21.15.143:0/2044619855 conn(0x7f7b8406daf0 msgr2=0x7f7b840b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:32.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.685+0000 7f7b8359e640 1 -- 172.21.15.143:0/2044619855 shutdown_connections 2024-05-08T10:24:32.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.685+0000 7f7b8359e640 1 -- 172.21.15.143:0/2044619855 wait complete. 2024-05-08T10:24:32.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.686+0000 7f7b8359e640 1 Processor -- start 2024-05-08T10:24:32.672 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.686+0000 7f7b8359e640 1 -- start start 2024-05-08T10:24:32.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b8359e640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8406c860 0x7f7b84142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b8359e640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b84141e60 0x7f7b841608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b8359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b84142240 0x7f7b84161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b8359e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7b84070a90 con 0x7f7b84142240 2024-05-08T10:24:32.674 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b8359e640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7b840b4f10 con 0x7f7b8406c860 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b8359e640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7b84070c10 con 0x7f7b84141e60 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b82d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b84142240 0x7f7b84161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b82d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b84142240 0x7f7b84161860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39188/0 (socket says 172.21.15.143:39188) 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b82d9d640 1 -- 172.21.15.143:0/1557274844 learned_addr learned my addr 172.21.15.143:0/1557274844 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b81d9b640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b84141e60 0x7f7b841608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b8259c640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8406c860 0x7f7b84142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b82d9d640 1 -- 172.21.15.143:0/1557274844 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b84141e60 msgr2=0x7f7b841608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b82d9d640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b84141e60 0x7f7b841608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b82d9d640 1 -- 172.21.15.143:0/1557274844 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8406c860 msgr2=0x7f7b84142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b82d9d640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8406c860 0x7f7b84142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b82d9d640 1 -- 172.21.15.143:0/1557274844 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b84159e40 con 0x7f7b84142240 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b8259c640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8406c860 0x7f7b84142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.687+0000 7f7b82d9d640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b84142240 0x7f7b84161860 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c035040 tx=0x7f7b7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:32.675 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.688+0000 7f7b72ffd640 1 -- 172.21.15.143:0/1557274844 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c037050 con 0x7f7b84142240 2024-05-08T10:24:32.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.688+0000 7f7b72ffd640 1 -- 172.21.15.143:0/1557274844 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c038040 con 0x7f7b84142240 2024-05-08T10:24:32.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.688+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b8415a120 con 0x7f7b84142240 2024-05-08T10:24:32.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.688+0000 7f7b72ffd640 1 -- 172.21.15.143:0/1557274844 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c004450 con 0x7f7b84142240 2024-05-08T10:24:32.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.688+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b84160e00 con 0x7f7b84142240 2024-05-08T10:24:32.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.689+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b84069450 con 0x7f7b84142240 2024-05-08T10:24:32.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.689+0000 7f7b72ffd640 1 -- 172.21.15.143:0/1557274844 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7b7c003610 con 0x7f7b84142240 2024-05-08T10:24:32.676 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.690+0000 7f7b72ffd640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7b640762d0 0x7f7b64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:32.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.690+0000 7f7b72ffd640 1 -- 172.21.15.143:0/1557274844 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f7b7c0b7ec0 con 0x7f7b84142240 2024-05-08T10:24:32.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.690+0000 7f7b8259c640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7b640762d0 0x7f7b64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:32.677 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.690+0000 7f7b8259c640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7b640762d0 0x7f7b64078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b74005c00 tx=0x7f7b74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:32.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.694+0000 7f7b72ffd640 1 -- 172.21.15.143:0/1557274844 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7b7c081830 con 0x7f7b84142240 2024-05-08T10:24:32.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.870+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b840d1990 con 0x7f7b640762d0 2024-05-08T10:24:32.860 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.876+0000 7f7b72ffd640 1 -- 172.21.15.143:0/1557274844 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239828 (secure 0 0 0) 0x7f7b840d1990 con 0x7f7b640762d0 2024-05-08T10:24:32.863 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:32.864 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:32.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.878+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7b640762d0 msgr2=0x7f7b64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.878+0000 7f7b8359e640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7b640762d0 0x7f7b64078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b74005c00 tx=0x7f7b74009040 comp rx=0 tx=0).stop 2024-05-08T10:24:32.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.878+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b84142240 msgr2=0x7f7b84161860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:32.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.878+0000 7f7b8359e640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b84142240 0x7f7b84161860 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c035040 tx=0x7f7b7c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.879+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 shutdown_connections 2024-05-08T10:24:32.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.879+0000 7f7b8359e640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7b640762d0 0x7f7b64078790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.879+0000 7f7b8359e640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b84142240 0x7f7b84161860 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.879+0000 7f7b8359e640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b84141e60 0x7f7b841608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.879+0000 7f7b8359e640 1 --2- 172.21.15.143:0/1557274844 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8406c860 0x7f7b84142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:32.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.879+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 >> 172.21.15.143:0/1557274844 conn(0x7f7b8406daf0 msgr2=0x7f7b8406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:32.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.879+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 shutdown_connections 2024-05-08T10:24:32.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:32.879+0000 7f7b8359e640 1 -- 172.21.15.143:0/1557274844 wait complete. 2024-05-08T10:24:32.875 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-08T10:24:32.532522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219764,"kb_used_data":3580,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754956,"statfs":{"total":773094113280,"available":772869074944,"internally_reserved":0,"allocated":3665920,"data_stored":2093191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.349085"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190662+0000","last_change":"2024-05-08T10:24:27.190662+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190662+0000","last_undegraded":"2024-05-08T10:24:27.190662+0000","last_fullsized":"2024-05-08T10:24:27.190662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474811+0000","last_change":"2024-05-08T10:24:27.474811+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474811+0000","last_undegraded":"2024-05-08T10:24:27.474811+0000","last_fullsized":"2024-05-08T10:24:27.474811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188359+0000","last_change":"2024-05-08T10:24:27.188359+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188359+0000","last_undegraded":"2024-05-08T10:24:27.188359+0000","last_fullsized":"2024-05-08T10:24:27.188359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187576+0000","last_change":"2024-05-08T10:24:27.187576+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187576+0000","last_undegraded":"2024-05-08T10:24:27.187576+0000","last_fullsized":"2024-05-08T10:24:27.187576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.189182+0000","last_change":"2024-05-08T10:24:27.189182+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.189182+0000","last_undegraded":"2024-05-08T10:24:27.189182+0000","last_fullsized":"2024-05-08T10:24:27.189182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188526+0000","last_change":"2024-05-08T10:24:27.188526+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188526+0000","last_undegraded":"2024-05-08T10:24:27.188526+0000","last_fullsized":"2024-05-08T10:24:27.188526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188131+0000","last_change":"2024-05-08T10:24:27.188131+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188131+0000","last_undegraded":"2024-05-08T10:24:27.188131+0000","last_fullsized":"2024-05-08T10:24:27.188131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188200+0000","last_change":"2024-05-08T10:24:27.188200+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188200+0000","last_undegraded":"2024-05-08T10:24:27.188200+0000","last_fullsized":"2024-05-08T10:24:27.188200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187771+0000","last_change":"2024-05-08T10:24:27.187771+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187771+0000","last_undegraded":"2024-05-08T10:24:27.187771+0000","last_fullsized":"2024-05-08T10:24:27.187771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474365+0000","last_change":"2024-05-08T10:24:27.474365+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474365+0000","last_undegraded":"2024-05-08T10:24:27.474365+0000","last_fullsized":"2024-05-08T10:24:27.474365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191825+0000","last_change":"2024-05-08T10:24:27.191825+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191825+0000","last_undegraded":"2024-05-08T10:24:27.191825+0000","last_fullsized":"2024-05-08T10:24:27.191825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187783+0000","last_change":"2024-05-08T10:24:27.187783+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187783+0000","last_undegraded":"2024-05-08T10:24:27.187783+0000","last_fullsized":"2024-05-08T10:24:27.187783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188749+0000","last_change":"2024-05-08T10:24:27.188749+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188749+0000","last_undegraded":"2024-05-08T10:24:27.188749+0000","last_fullsized":"2024-05-08T10:24:27.188749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191538+0000","last_change":"2024-05-08T10:24:27.191538+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191538+0000","last_undegraded":"2024-05-08T10:24:27.191538+0000","last_fullsized":"2024-05-08T10:24:27.191538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187641+0000","last_change":"2024-05-08T10:24:27.187641+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187641+0000","last_undegraded":"2024-05-08T10:24:27.187641+0000","last_fullsized":"2024-05-08T10:24:27.187641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187628+0000","last_change":"2024-05-08T10:24:27.187628+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187628+0000","last_undegraded":"2024-05-08T10:24:27.187628+0000","last_fullsized":"2024-05-08T10:24:27.187628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191576+0000","last_change":"2024-05-08T10:24:27.191576+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191576+0000","last_undegraded":"2024-05-08T10:24:27.191576+0000","last_fullsized":"2024-05-08T10:24:27.191576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188195+0000","last_change":"2024-05-08T10:24:27.188195+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188195+0000","last_undegraded":"2024-05-08T10:24:27.188195+0000","last_fullsized":"2024-05-08T10:24:27.188195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187962+0000","last_change":"2024-05-08T10:24:27.187962+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187962+0000","last_undegraded":"2024-05-08T10:24:27.187962+0000","last_fullsized":"2024-05-08T10:24:27.187962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188076+0000","last_change":"2024-05-08T10:24:27.188076+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188076+0000","last_undegraded":"2024-05-08T10:24:27.188076+0000","last_fullsized":"2024-05-08T10:24:27.188076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474375+0000","last_change":"2024-05-08T10:24:27.474375+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474375+0000","last_undegraded":"2024-05-08T10:24:27.474375+0000","last_fullsized":"2024-05-08T10:24:27.474375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190652+0000","last_change":"2024-05-08T10:24:27.190652+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190652+0000","last_undegraded":"2024-05-08T10:24:27.190652+0000","last_fullsized":"2024-05-08T10:24:27.190652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.189023+0000","last_change":"2024-05-08T10:24:27.189023+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.189023+0000","last_undegraded":"2024-05-08T10:24:27.189023+0000","last_fullsized":"2024-05-08T10:24:27.189023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191806+0000","last_change":"2024-05-08T10:24:27.191806+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191806+0000","last_undegraded":"2024-05-08T10:24:27.191806+0000","last_fullsized":"2024-05-08T10:24:27.191806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191063+0000","last_change":"2024-05-08T10:24:27.191063+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191063+0000","last_undegraded":"2024-05-08T10:24:27.191063+0000","last_fullsized":"2024-05-08T10:24:27.191063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.473918+0000","last_change":"2024-05-08T10:24:27.473918+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.473918+0000","last_undegraded":"2024-05-08T10:24:27.473918+0000","last_fullsized":"2024-05-08T10:24:27.473918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191014+0000","last_change":"2024-05-08T10:24:27.191014+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191014+0000","last_undegraded":"2024-05-08T10:24:27.191014+0000","last_fullsized":"2024-05-08T10:24:27.191014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.473922+0000","last_change":"2024-05-08T10:24:27.473922+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.473922+0000","last_undegraded":"2024-05-08T10:24:27.473922+0000","last_fullsized":"2024-05-08T10:24:27.473922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191006+0000","last_change":"2024-05-08T10:24:27.191006+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191006+0000","last_undegraded":"2024-05-08T10:24:27.191006+0000","last_fullsized":"2024-05-08T10:24:27.191006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187962+0000","last_change":"2024-05-08T10:24:27.187962+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187962+0000","last_undegraded":"2024-05-08T10:24:27.187962+0000","last_fullsized":"2024-05-08T10:24:27.187962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.186511+0000","last_change":"2024-05-08T10:24:27.186511+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.186511+0000","last_undegraded":"2024-05-08T10:24:27.186511+0000","last_fullsized":"2024-05-08T10:24:27.186511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190715+0000","last_change":"2024-05-08T10:24:27.190715+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190715+0000","last_undegraded":"2024-05-08T10:24:27.190715+0000","last_fullsized":"2024-05-08T10:24:27.190715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-08T10:24:27.190076+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:24:27.190076+0000","last_peered":"2024-05-08T10:24:27.190076+0000","last_clean":"2024-05-08T10:24:27.190076+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:27.190076+0000","last_undegraded":"2024-05-08T10:24:27.190076+0000","last_fullsized":"2024-05-08T10:24:27.190076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":699335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-05-08T10:24:32.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-05-08T10:24:32.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-05-08T10:24:32.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-05-08T10:24:32.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-05-08T10:24:32.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.190662+0000', 'last_change': '2024-05-08T10:24:27.190662+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.190662+0000', 'last_undegraded': '2024-05-08T10:24:27.190662+0000', 'last_fullsized': '2024-05-08T10:24:27.190662+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.474811+0000', 'last_change': '2024-05-08T10:24:27.474811+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.474811+0000', 'last_undegraded': '2024-05-08T10:24:27.474811+0000', 'last_fullsized': '2024-05-08T10:24:27.474811+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:24:32.885 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.188359+0000', 'last_change': '2024-05-08T10:24:27.188359+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.188359+0000', 'last_undegraded': '2024-05-08T10:24:27.188359+0000', 'last_fullsized': '2024-05-08T10:24:27.188359+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.187576+0000', 'last_change': '2024-05-08T10:24:27.187576+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.187576+0000', 'last_undegraded': '2024-05-08T10:24:27.187576+0000', 'last_fullsized': '2024-05-08T10:24:27.187576+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-05-08T10:24:32.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.189182+0000', 'last_change': '2024-05-08T10:24:27.189182+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.189182+0000', 'last_undegraded': '2024-05-08T10:24:27.189182+0000', 'last_fullsized': '2024-05-08T10:24:27.189182+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.188526+0000', 'last_change': '2024-05-08T10:24:27.188526+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.188526+0000', 'last_undegraded': '2024-05-08T10:24:27.188526+0000', 'last_fullsized': '2024-05-08T10:24:27.188526+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.188131+0000', 'last_change': '2024-05-08T10:24:27.188131+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.188131+0000', 'last_undegraded': '2024-05-08T10:24:27.188131+0000', 'last_fullsized': '2024-05-08T10:24:27.188131+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-05-08T10:24:32.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.188200+0000', 'last_change': '2024-05-08T10:24:27.188200+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.188200+0000', 'last_undegraded': '2024-05-08T10:24:27.188200+0000', 'last_fullsized': '2024-05-08T10:24:27.188200+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.187771+0000', 'last_change': '2024-05-08T10:24:27.187771+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.187771+0000', 'last_undegraded': '2024-05-08T10:24:27.187771+0000', 'last_fullsized': '2024-05-08T10:24:27.187771+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.474365+0000', 'last_change': '2024-05-08T10:24:27.474365+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.474365+0000', 'last_undegraded': '2024-05-08T10:24:27.474365+0000', 'last_fullsized': '2024-05-08T10:24:27.474365+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:24:32.888 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.191825+0000', 'last_change': '2024-05-08T10:24:27.191825+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.191825+0000', 'last_undegraded': '2024-05-08T10:24:27.191825+0000', 'last_fullsized': '2024-05-08T10:24:27.191825+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.187783+0000', 'last_change': '2024-05-08T10:24:27.187783+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.187783+0000', 'last_undegraded': '2024-05-08T10:24:27.187783+0000', 'last_fullsized': '2024-05-08T10:24:27.187783+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.889 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.188749+0000', 'last_change': '2024-05-08T10:24:27.188749+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.188749+0000', 'last_undegraded': '2024-05-08T10:24:27.188749+0000', 'last_fullsized': '2024-05-08T10:24:27.188749+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.191538+0000', 'last_change': '2024-05-08T10:24:27.191538+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.191538+0000', 'last_undegraded': '2024-05-08T10:24:27.191538+0000', 'last_fullsized': '2024-05-08T10:24:27.191538+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.187641+0000', 'last_change': '2024-05-08T10:24:27.187641+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.187641+0000', 'last_undegraded': '2024-05-08T10:24:27.187641+0000', 'last_fullsized': '2024-05-08T10:24:27.187641+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-05-08T10:24:32.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.187628+0000', 'last_change': '2024-05-08T10:24:27.187628+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.187628+0000', 'last_undegraded': '2024-05-08T10:24:27.187628+0000', 'last_fullsized': '2024-05-08T10:24:27.187628+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.191576+0000', 'last_change': '2024-05-08T10:24:27.191576+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.191576+0000', 'last_undegraded': '2024-05-08T10:24:27.191576+0000', 'last_fullsized': '2024-05-08T10:24:27.191576+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-05-08T10:24:32.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.188195+0000', 'last_change': '2024-05-08T10:24:27.188195+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.188195+0000', 'last_undegraded': '2024-05-08T10:24:27.188195+0000', 'last_fullsized': '2024-05-08T10:24:27.188195+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.187962+0000', 'last_change': '2024-05-08T10:24:27.187962+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.187962+0000', 'last_undegraded': '2024-05-08T10:24:27.187962+0000', 'last_fullsized': '2024-05-08T10:24:27.187962+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.188076+0000', 'last_change': '2024-05-08T10:24:27.188076+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.188076+0000', 'last_undegraded': '2024-05-08T10:24:27.188076+0000', 'last_fullsized': '2024-05-08T10:24:27.188076+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.892 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.474375+0000', 'last_change': '2024-05-08T10:24:27.474375+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.474375+0000', 'last_undegraded': '2024-05-08T10:24:27.474375+0000', 'last_fullsized': '2024-05-08T10:24:27.474375+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.190652+0000', 'last_change': '2024-05-08T10:24:27.190652+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.190652+0000', 'last_undegraded': '2024-05-08T10:24:27.190652+0000', 'last_fullsized': '2024-05-08T10:24:27.190652+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.189023+0000', 'last_change': '2024-05-08T10:24:27.189023+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.189023+0000', 'last_undegraded': '2024-05-08T10:24:27.189023+0000', 'last_fullsized': '2024-05-08T10:24:27.189023+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-05-08T10:24:32.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.191806+0000', 'last_change': '2024-05-08T10:24:27.191806+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.191806+0000', 'last_undegraded': '2024-05-08T10:24:27.191806+0000', 'last_fullsized': '2024-05-08T10:24:27.191806+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.191063+0000', 'last_change': '2024-05-08T10:24:27.191063+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.191063+0000', 'last_undegraded': '2024-05-08T10:24:27.191063+0000', 'last_fullsized': '2024-05-08T10:24:27.191063+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.473918+0000', 'last_change': '2024-05-08T10:24:27.473918+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.473918+0000', 'last_undegraded': '2024-05-08T10:24:27.473918+0000', 'last_fullsized': '2024-05-08T10:24:27.473918+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:24:32.894 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.191014+0000', 'last_change': '2024-05-08T10:24:27.191014+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.191014+0000', 'last_undegraded': '2024-05-08T10:24:27.191014+0000', 'last_fullsized': '2024-05-08T10:24:27.191014+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.473922+0000', 'last_change': '2024-05-08T10:24:27.473922+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.473922+0000', 'last_undegraded': '2024-05-08T10:24:27.473922+0000', 'last_fullsized': '2024-05-08T10:24:27.473922+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-05-08T10:24:32.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.191006+0000', 'last_change': '2024-05-08T10:24:27.191006+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.191006+0000', 'last_undegraded': '2024-05-08T10:24:27.191006+0000', 'last_fullsized': '2024-05-08T10:24:27.191006+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.187962+0000', 'last_change': '2024-05-08T10:24:27.187962+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.187962+0000', 'last_undegraded': '2024-05-08T10:24:27.187962+0000', 'last_fullsized': '2024-05-08T10:24:27.187962+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.186511+0000', 'last_change': '2024-05-08T10:24:27.186511+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.186511+0000', 'last_undegraded': '2024-05-08T10:24:27.186511+0000', 'last_fullsized': '2024-05-08T10:24:27.186511+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-05-08T10:24:32.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T10:24:28.183352+0000', 'last_change': '2024-05-08T10:24:28.183352+0000', 'last_active': '2024-05-08T10:24:28.183352+0000', 'last_peered': '2024-05-08T10:24:28.183352+0000', 'last_clean': '2024-05-08T10:24:28.183352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:28.183352+0000', 'last_undegraded': '2024-05-08T10:24:28.183352+0000', 'last_fullsized': '2024-05-08T10:24:28.183352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:28.183352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T10:24:32.897 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-05-08T10:24:32.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-05-08T10:24:27.190715+0000', 'last_change': '2024-05-08T10:24:27.190715+0000', 'last_active': '2024-05-08T10:24:27.178799+0000', 'last_peered': '2024-05-08T10:24:27.178799+0000', 'last_clean': '2024-05-08T10:24:27.178799+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T10:24:27.190715+0000', 'last_undegraded': '2024-05-08T10:24:27.190715+0000', 'last_fullsized': '2024-05-08T10:24:27.190715+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'last_clean_scrub_stamp': '2024-05-08T10:24:27.178799+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T10:24:32.897 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-08T10:24:32.994 INFO:tasks.ceph.mds.a.smithi143.stderr:2024-05-08T10:24:33.009+0000 7fe23f6ca640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T10:24:33.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.029+0000 7f1752df0640 1 Processor -- start 2024-05-08T10:24:33.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.029+0000 7f1752df0640 1 -- start start 2024-05-08T10:24:33.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1752df0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f174c15bf20 0x7f174c073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1752df0640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f174c072510 0x7f174c06fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1752df0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c070230 0x7f174c0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1752df0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f174c0b4050 con 0x7f174c15bf20 2024-05-08T10:24:33.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1752df0640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f174c0b4330 con 0x7f174c072510 2024-05-08T10:24:33.016 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1752df0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f174c0b4610 con 0x7f174c070230 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1750b8c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f174c15bf20 0x7f174c073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1750b8c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f174c15bf20 0x7f174c073860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39198/0 (socket says 172.21.15.143:39198) 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1750b8c640 1 -- 172.21.15.143:0/1503141867 learned_addr learned my addr 172.21.15.143:0/1503141867 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1750b8c640 1 -- 172.21.15.143:0/1503141867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c070230 msgr2=0x7f174c0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f175138d640 1 --2- 172.21.15.143:0/1503141867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c070230 0x7f174c0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1750b8c640 1 --2- 172.21.15.143:0/1503141867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c070230 0x7f174c0b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1750b8c640 1 -- 172.21.15.143:0/1503141867 >> v2:172.21.15.163:3300/0 conn(0x7f174c072510 msgr2=0x7f174c06fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1743fff640 1 --2- 172.21.15.143:0/1503141867 >> v2:172.21.15.163:3300/0 conn(0x7f174c072510 0x7f174c06fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1750b8c640 1 --2- 172.21.15.143:0/1503141867 >> v2:172.21.15.163:3300/0 conn(0x7f174c072510 0x7f174c06fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.030+0000 7f1750b8c640 1 -- 172.21.15.143:0/1503141867 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c0b48f0 con 0x7f174c15bf20 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.031+0000 7f1750b8c640 1 --2- 172.21.15.143:0/1503141867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c15bf20 0x7f174c073860 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f174c075da0 tx=0x7f174802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f840f787018ed60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.031+0000 7f17437fe640 1 -- 172.21.15.143:0/1503141867 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748036070 con 0x7f174c15bf20 2024-05-08T10:24:33.017 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.031+0000 7f17437fe640 1 -- 172.21.15.143:0/1503141867 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1748031600 con 0x7f174c15bf20 2024-05-08T10:24:33.018 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.031+0000 7f17437fe640 1 -- 172.21.15.143:0/1503141867 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17480319d0 con 0x7f174c15bf20 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.032+0000 7f1752df0640 1 -- 172.21.15.143:0/1503141867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c15bf20 msgr2=0x7f174c073860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.032+0000 7f1752df0640 1 --2- 172.21.15.143:0/1503141867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c15bf20 0x7f174c073860 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f174c075da0 tx=0x7f174802a6a0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.032+0000 7f1752df0640 1 -- 172.21.15.143:0/1503141867 shutdown_connections 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.032+0000 7f1752df0640 1 --2- 172.21.15.143:0/1503141867 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c070230 0x7f174c0b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.032+0000 7f1752df0640 1 --2- 172.21.15.143:0/1503141867 >> v2:172.21.15.163:3300/0 conn(0x7f174c072510 0x7f174c06fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.032+0000 7f1752df0640 1 --2- 172.21.15.143:0/1503141867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c15bf20 0x7f174c073860 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.032+0000 7f1752df0640 1 -- 172.21.15.143:0/1503141867 >> 172.21.15.143:0/1503141867 conn(0x7f174c0b2bb0 msgr2=0x7f174c0b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.032+0000 7f1752df0640 1 -- 172.21.15.143:0/1503141867 shutdown_connections 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.032+0000 7f1752df0640 1 -- 172.21.15.143:0/1503141867 wait complete. 2024-05-08T10:24:33.021 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.033+0000 7f1752df0640 1 Processor -- start 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.033+0000 7f1752df0640 1 -- start start 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1752df0640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f174c070230 0x7f174c14c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1752df0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c072510 0x7f174c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1752df0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c15bf20 0x7f174c09de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1752df0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f174c15c480 con 0x7f174c072510 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1752df0640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f174c15c300 con 0x7f174c070230 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1752df0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f174c0b5830 con 0x7f174c15bf20 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1743fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c072510 0x7f174c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1743fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c072510 0x7f174c0afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39202/0 (socket says 172.21.15.143:39202) 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1743fff640 1 -- 172.21.15.143:0/2450073271 learned_addr learned my addr 172.21.15.143:0/2450073271 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:33.022 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f175138d640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c15bf20 0x7f174c09de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1750b8c640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f174c070230 0x7f174c14c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1743fff640 1 -- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c15bf20 msgr2=0x7f174c09de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1743fff640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c15bf20 0x7f174c09de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1743fff640 1 -- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f174c070230 msgr2=0x7f174c14c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1743fff640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f174c070230 0x7f174c14c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1743fff640 1 -- 172.21.15.143:0/2450073271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c0cec10 con 0x7f174c072510 2024-05-08T10:24:33.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f175138d640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c15bf20 0x7f174c09de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:33.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1750b8c640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f174c070230 0x7f174c14c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:33.023 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f1743fff640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c072510 0x7f174c0afa70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f173c00c7f0 tx=0x7f173c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:33.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.034+0000 7f17417fa640 1 -- 172.21.15.143:0/2450073271 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c015070 con 0x7f174c072510 2024-05-08T10:24:33.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.035+0000 7f17417fa640 1 -- 172.21.15.143:0/2450073271 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173c004240 con 0x7f174c072510 2024-05-08T10:24:33.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.035+0000 7f17417fa640 1 -- 172.21.15.143:0/2450073271 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c007620 con 0x7f174c072510 2024-05-08T10:24:33.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.035+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c0ceef0 con 0x7f174c072510 2024-05-08T10:24:33.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.035+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c0cf4b0 con 0x7f174c072510 2024-05-08T10:24:33.024 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.035+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174c06a4b0 con 0x7f174c072510 2024-05-08T10:24:33.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.036+0000 7f17417fa640 1 -- 172.21.15.143:0/2450073271 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f173c0079d0 con 0x7f174c072510 2024-05-08T10:24:33.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.037+0000 7f17417fa640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f17380762d0 0x7f1738078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.037+0000 7f17417fa640 1 -- 172.21.15.143:0/2450073271 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f173c097610 con 0x7f174c072510 2024-05-08T10:24:33.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.037+0000 7f1750b8c640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f17380762d0 0x7f1738078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.025 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.037+0000 7f1750b8c640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f17380762d0 0x7f1738078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1748033000 tx=0x7f1748009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:33.026 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.041+0000 7f17417fa640 1 -- 172.21.15.143:0/2450073271 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f173c060f70 con 0x7f174c072510 2024-05-08T10:24:33.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.294+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f174c0b37d0 con 0x7f174c072510 2024-05-08T10:24:33.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.294+0000 7f17417fa640 1 -- 172.21.15.143:0/2450073271 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1108 (secure 0 0 0) 0x7f173c060870 con 0x7f174c072510 2024-05-08T10:24:33.279 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:33.279 INFO:teuthology.orchestra.run.smithi143.stdout:{"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":61,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1715163822,"num_in_osds":8,"osd_in_since":1715163814,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225038336,"bytes_avail":772869074944,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4797}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-08T10:23:32.148828+0000","services":{}},"progress_events":{}} 2024-05-08T10:24:33.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f17380762d0 msgr2=0x7f1738078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f17380762d0 0x7f1738078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1748033000 tx=0x7f1748009000 comp rx=0 tx=0).stop 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c072510 msgr2=0x7f174c0afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c072510 0x7f174c0afa70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f173c00c7f0 tx=0x7f173c00ccb0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 shutdown_connections 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f174c15bf20 0x7f174c09de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f17380762d0 0x7f1738078790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f174c072510 0x7f174c0afa70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 --2- 172.21.15.143:0/2450073271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f174c070230 0x7f174c14c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 >> 172.21.15.143:0/2450073271 conn(0x7f174c0b2bb0 msgr2=0x7f174c0b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 shutdown_connections 2024-05-08T10:24:33.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.296+0000 7f1752df0640 1 -- 172.21.15.143:0/2450073271 wait complete. 2024-05-08T10:24:33.292 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-08T10:24:33.293 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:33.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.407+0000 7ff9d37dd640 1 Processor -- start 2024-05-08T10:24:33.392 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.407+0000 7ff9d37dd640 1 -- start start 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d37dd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff9cc15c020 0x7ff9cc073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d37dd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc0b48b0 0x7ff9cc0afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d37dd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9cc072f80 con 0x7ff9cc0ae180 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d37dd640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff9cc0ae700 con 0x7ff9cc15c020 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d37dd640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ff9cc073290 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d1579640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff9cc15c020 0x7ff9cc073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d0d78640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff9cc0ae180 0x7ff9cc0b41a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33070/0 (socket says 172.21.15.143:33070) 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d1579640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff9cc15c020 0x7ff9cc073720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39214/0 (socket says 172.21.15.143:39214) 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d0d78640 1 -- 172.21.15.143:0/314168789 learned_addr learned my addr 172.21.15.143:0/314168789 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d1d7a640 1 --2- 172.21.15.143:0/314168789 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc0b48b0 0x7ff9cc0afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.408+0000 7ff9d1579640 1 -- 172.21.15.143:0/314168789 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc0b48b0 msgr2=0x7ff9cc0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.409+0000 7ff9d1579640 1 --2- 172.21.15.143:0/314168789 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc0b48b0 0x7ff9cc0afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.409+0000 7ff9d1579640 1 -- 172.21.15.143:0/314168789 >> v1:172.21.15.143:6789/0 conn(0x7ff9cc0ae180 legacy=0x7ff9cc0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.409+0000 7ff9d1579640 1 -- 172.21.15.143:0/314168789 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc074430 con 0x7ff9cc15c020 2024-05-08T10:24:33.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.409+0000 7ff9d1d7a640 1 --2- 172.21.15.143:0/314168789 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc0b48b0 0x7ff9cc0afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:33.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.409+0000 7ff9d1579640 1 --2- 172.21.15.143:0/314168789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc15c020 0x7ff9cc073720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800ba40 tx=0x7ff9c802c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1162312fc58e1b5c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:33.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.409+0000 7ff9c3fff640 1 -- 172.21.15.143:0/314168789 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8031710 con 0x7ff9cc15c020 2024-05-08T10:24:33.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.409+0000 7ff9c3fff640 1 -- 172.21.15.143:0/314168789 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c80318b0 con 0x7ff9cc15c020 2024-05-08T10:24:33.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.409+0000 7ff9c3fff640 1 -- 172.21.15.143:0/314168789 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8031c80 con 0x7ff9cc15c020 2024-05-08T10:24:33.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.410+0000 7ff9d37dd640 1 -- 172.21.15.143:0/314168789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc15c020 msgr2=0x7ff9cc073720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.410+0000 7ff9d37dd640 1 --2- 172.21.15.143:0/314168789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc15c020 0x7ff9cc073720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800ba40 tx=0x7ff9c802c720 comp rx=0 tx=0).stop 2024-05-08T10:24:33.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.410+0000 7ff9d37dd640 1 -- 172.21.15.143:0/314168789 shutdown_connections 2024-05-08T10:24:33.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.410+0000 7ff9d37dd640 1 --2- 172.21.15.143:0/314168789 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc0b48b0 0x7ff9cc0afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.410+0000 7ff9d37dd640 1 --2- 172.21.15.143:0/314168789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc15c020 0x7ff9cc073720 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.410+0000 7ff9d37dd640 1 -- 172.21.15.143:0/314168789 >> 172.21.15.143:0/314168789 conn(0x7ff9cc06c500 msgr2=0x7ff9cc06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:33.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.410+0000 7ff9d37dd640 1 -- 172.21.15.143:0/314168789 shutdown_connections 2024-05-08T10:24:33.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.410+0000 7ff9d37dd640 1 -- 172.21.15.143:0/314168789 wait complete. 2024-05-08T10:24:33.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.411+0000 7ff9d37dd640 1 Processor -- start 2024-05-08T10:24:33.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.411+0000 7ff9d37dd640 1 -- start start 2024-05-08T10:24:33.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d37dd640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9cc0ae180 0x7ff9cc148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d37dd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc0b48b0 0x7ff9cc15ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d37dd640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc15c020 0x7ff9cc160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d37dd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc0d0860 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d37dd640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc15c400 con 0x7ff9cc0ae180 2024-05-08T10:24:33.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d37dd640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ff9cc073c60 con 0x7ff9cc15c020 2024-05-08T10:24:33.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d0d78640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc0b48b0 0x7ff9cc15ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d0d78640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc0b48b0 0x7ff9cc15ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39222/0 (socket says 172.21.15.143:39222) 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d0d78640 1 -- 172.21.15.143:0/2701409454 learned_addr learned my addr 172.21.15.143:0/2701409454 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d1d7a640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc15c020 0x7ff9cc160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d0d78640 1 -- 172.21.15.143:0/2701409454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc15c020 msgr2=0x7ff9cc160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d1579640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9cc0ae180 0x7ff9cc148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d0d78640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc15c020 0x7ff9cc160500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d0d78640 1 -- 172.21.15.143:0/2701409454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9cc0ae180 msgr2=0x7ff9cc148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d0d78640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9cc0ae180 0x7ff9cc148790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d0d78640 1 -- 172.21.15.143:0/2701409454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc1589e0 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d1d7a640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc15c020 0x7ff9cc160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.412+0000 7ff9d0d78640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc0b48b0 0x7ff9cc15ffc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc001eb0 tx=0x7ff9bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.413+0000 7ff9c1ffb640 1 -- 172.21.15.143:0/2701409454 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc017070 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.413+0000 7ff9c1ffb640 1 -- 172.21.15.143:0/2701409454 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc005d00 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.413+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9cc158cc0 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.413+0000 7ff9c1ffb640 1 -- 172.21.15.143:0/2701409454 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc007310 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.413+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9cc159280 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.414+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9cc06a550 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.414+0000 7ff9c1ffb640 1 -- 172.21.15.143:0/2701409454 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff9bc01a070 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.415+0000 7ff9c1ffb640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff9b00762d0 0x7ff9b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:33.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.415+0000 7ff9c1ffb640 1 -- 172.21.15.143:0/2701409454 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff9bc096900 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.415+0000 7ff9d1579640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff9b00762d0 0x7ff9b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:33.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.415+0000 7ff9d1579640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff9b00762d0 0x7ff9b0078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8036000 tx=0x7ff9c8035040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:33.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.419+0000 7ff9c1ffb640 1 -- 172.21.15.143:0/2701409454 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff9cc072f80 con 0x7ff9cc0b48b0 2024-05-08T10:24:33.581 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.596+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9cc148cd0 con 0x7ff9b00762d0 2024-05-08T10:24:33.587 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.602+0000 7ff9c1ffb640 1 -- 172.21.15.143:0/2701409454 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239828 (secure 0 0 0) 0x7ff9cc148cd0 con 0x7ff9b00762d0 2024-05-08T10:24:33.589 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:33.590 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:33.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff9b00762d0 msgr2=0x7ff9b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff9b00762d0 0x7ff9b0078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8036000 tx=0x7ff9c8035040 comp rx=0 tx=0).stop 2024-05-08T10:24:33.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc0b48b0 msgr2=0x7ff9cc15ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:33.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc0b48b0 0x7ff9cc15ffc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc001eb0 tx=0x7ff9bc00c890 comp rx=0 tx=0).stop 2024-05-08T10:24:33.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 shutdown_connections 2024-05-08T10:24:33.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9cc15c020 0x7ff9cc160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff9b00762d0 0x7ff9b0078790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9cc0b48b0 0x7ff9cc15ffc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 --2- 172.21.15.143:0/2701409454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9cc0ae180 0x7ff9cc148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:33.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 >> 172.21.15.143:0/2701409454 conn(0x7ff9cc06c500 msgr2=0x7ff9cc0b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:33.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 shutdown_connections 2024-05-08T10:24:33.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:33.605+0000 7ff9d37dd640 1 -- 172.21.15.143:0/2701409454 wait complete. 2024-05-08T10:24:33.602 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-08T10:24:32.532522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219764,"kb_used_data":3580,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754956,"statfs":{"total":773094113280,"available":772869074944,"internally_reserved":0,"allocated":3665920,"data_stored":2093191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.349085"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190662+0000","last_change":"2024-05-08T10:24:27.190662+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190662+0000","last_undegraded":"2024-05-08T10:24:27.190662+0000","last_fullsized":"2024-05-08T10:24:27.190662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474811+0000","last_change":"2024-05-08T10:24:27.474811+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474811+0000","last_undegraded":"2024-05-08T10:24:27.474811+0000","last_fullsized":"2024-05-08T10:24:27.474811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188359+0000","last_change":"2024-05-08T10:24:27.188359+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188359+0000","last_undegraded":"2024-05-08T10:24:27.188359+0000","last_fullsized":"2024-05-08T10:24:27.188359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187576+0000","last_change":"2024-05-08T10:24:27.187576+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187576+0000","last_undegraded":"2024-05-08T10:24:27.187576+0000","last_fullsized":"2024-05-08T10:24:27.187576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.189182+0000","last_change":"2024-05-08T10:24:27.189182+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.189182+0000","last_undegraded":"2024-05-08T10:24:27.189182+0000","last_fullsized":"2024-05-08T10:24:27.189182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188526+0000","last_change":"2024-05-08T10:24:27.188526+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188526+0000","last_undegraded":"2024-05-08T10:24:27.188526+0000","last_fullsized":"2024-05-08T10:24:27.188526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188131+0000","last_change":"2024-05-08T10:24:27.188131+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188131+0000","last_undegraded":"2024-05-08T10:24:27.188131+0000","last_fullsized":"2024-05-08T10:24:27.188131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188200+0000","last_change":"2024-05-08T10:24:27.188200+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188200+0000","last_undegraded":"2024-05-08T10:24:27.188200+0000","last_fullsized":"2024-05-08T10:24:27.188200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187771+0000","last_change":"2024-05-08T10:24:27.187771+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187771+0000","last_undegraded":"2024-05-08T10:24:27.187771+0000","last_fullsized":"2024-05-08T10:24:27.187771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474365+0000","last_change":"2024-05-08T10:24:27.474365+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474365+0000","last_undegraded":"2024-05-08T10:24:27.474365+0000","last_fullsized":"2024-05-08T10:24:27.474365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191825+0000","last_change":"2024-05-08T10:24:27.191825+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191825+0000","last_undegraded":"2024-05-08T10:24:27.191825+0000","last_fullsized":"2024-05-08T10:24:27.191825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187783+0000","last_change":"2024-05-08T10:24:27.187783+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187783+0000","last_undegraded":"2024-05-08T10:24:27.187783+0000","last_fullsized":"2024-05-08T10:24:27.187783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188749+0000","last_change":"2024-05-08T10:24:27.188749+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188749+0000","last_undegraded":"2024-05-08T10:24:27.188749+0000","last_fullsized":"2024-05-08T10:24:27.188749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191538+0000","last_change":"2024-05-08T10:24:27.191538+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191538+0000","last_undegraded":"2024-05-08T10:24:27.191538+0000","last_fullsized":"2024-05-08T10:24:27.191538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187641+0000","last_change":"2024-05-08T10:24:27.187641+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187641+0000","last_undegraded":"2024-05-08T10:24:27.187641+0000","last_fullsized":"2024-05-08T10:24:27.187641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187628+0000","last_change":"2024-05-08T10:24:27.187628+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187628+0000","last_undegraded":"2024-05-08T10:24:27.187628+0000","last_fullsized":"2024-05-08T10:24:27.187628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191576+0000","last_change":"2024-05-08T10:24:27.191576+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191576+0000","last_undegraded":"2024-05-08T10:24:27.191576+0000","last_fullsized":"2024-05-08T10:24:27.191576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188195+0000","last_change":"2024-05-08T10:24:27.188195+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188195+0000","last_undegraded":"2024-05-08T10:24:27.188195+0000","last_fullsized":"2024-05-08T10:24:27.188195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187962+0000","last_change":"2024-05-08T10:24:27.187962+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187962+0000","last_undegraded":"2024-05-08T10:24:27.187962+0000","last_fullsized":"2024-05-08T10:24:27.187962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.188076+0000","last_change":"2024-05-08T10:24:27.188076+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.188076+0000","last_undegraded":"2024-05-08T10:24:27.188076+0000","last_fullsized":"2024-05-08T10:24:27.188076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.474375+0000","last_change":"2024-05-08T10:24:27.474375+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.474375+0000","last_undegraded":"2024-05-08T10:24:27.474375+0000","last_fullsized":"2024-05-08T10:24:27.474375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190652+0000","last_change":"2024-05-08T10:24:27.190652+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190652+0000","last_undegraded":"2024-05-08T10:24:27.190652+0000","last_fullsized":"2024-05-08T10:24:27.190652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.189023+0000","last_change":"2024-05-08T10:24:27.189023+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.189023+0000","last_undegraded":"2024-05-08T10:24:27.189023+0000","last_fullsized":"2024-05-08T10:24:27.189023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191806+0000","last_change":"2024-05-08T10:24:27.191806+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191806+0000","last_undegraded":"2024-05-08T10:24:27.191806+0000","last_fullsized":"2024-05-08T10:24:27.191806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191063+0000","last_change":"2024-05-08T10:24:27.191063+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191063+0000","last_undegraded":"2024-05-08T10:24:27.191063+0000","last_fullsized":"2024-05-08T10:24:27.191063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.473918+0000","last_change":"2024-05-08T10:24:27.473918+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.473918+0000","last_undegraded":"2024-05-08T10:24:27.473918+0000","last_fullsized":"2024-05-08T10:24:27.473918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191014+0000","last_change":"2024-05-08T10:24:27.191014+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191014+0000","last_undegraded":"2024-05-08T10:24:27.191014+0000","last_fullsized":"2024-05-08T10:24:27.191014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.473922+0000","last_change":"2024-05-08T10:24:27.473922+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.473922+0000","last_undegraded":"2024-05-08T10:24:27.473922+0000","last_fullsized":"2024-05-08T10:24:27.473922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.191006+0000","last_change":"2024-05-08T10:24:27.191006+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.191006+0000","last_undegraded":"2024-05-08T10:24:27.191006+0000","last_fullsized":"2024-05-08T10:24:27.191006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.187962+0000","last_change":"2024-05-08T10:24:27.187962+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.187962+0000","last_undegraded":"2024-05-08T10:24:27.187962+0000","last_fullsized":"2024-05-08T10:24:27.187962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.186511+0000","last_change":"2024-05-08T10:24:27.186511+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.186511+0000","last_undegraded":"2024-05-08T10:24:27.186511+0000","last_fullsized":"2024-05-08T10:24:27.186511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:24:28.183352+0000","last_change":"2024-05-08T10:24:28.183352+0000","last_active":"2024-05-08T10:24:28.183352+0000","last_peered":"2024-05-08T10:24:28.183352+0000","last_clean":"2024-05-08T10:24:28.183352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:28.183352+0000","last_undegraded":"2024-05-08T10:24:28.183352+0000","last_fullsized":"2024-05-08T10:24:28.183352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-08T10:24:27.190715+0000","last_change":"2024-05-08T10:24:27.190715+0000","last_active":"2024-05-08T10:24:27.178799+0000","last_peered":"2024-05-08T10:24:27.178799+0000","last_clean":"2024-05-08T10:24:27.178799+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:24:27.190715+0000","last_undegraded":"2024-05-08T10:24:27.190715+0000","last_fullsized":"2024-05-08T10:24:27.190715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-08T10:24:27.190076+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:24:27.190076+0000","last_peered":"2024-05-08T10:24:27.190076+0000","last_clean":"2024-05-08T10:24:27.190076+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:27.190076+0000","last_undegraded":"2024-05-08T10:24:27.190076+0000","last_fullsized":"2024-05-08T10:24:27.190076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":699335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:36.607 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:36.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.731+0000 7fe62c1a4640 1 Processor -- start 2024-05-08T10:24:36.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.731+0000 7fe62c1a4640 1 -- start start 2024-05-08T10:24:36.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.732+0000 7fe62c1a4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe6240ae180 0x7fe6240b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:36.719 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.732+0000 7fe62c1a4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe624072f80 con 0x7fe62415c020 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.732+0000 7fe62c1a4640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe624074430 con 0x7fe6240b46e0 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.732+0000 7fe62c1a4640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fe6240ae700 con 0x7fe6240ae180 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.732+0000 7fe629f40640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe62415c020 0x7fe624073720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:35492/0 (socket says 172.21.15.143:35492) 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.732+0000 7fe629f40640 1 -- 172.21.15.143:0/4233027489 learned_addr learned my addr 172.21.15.143:0/4233027489 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610345167 0 0) 0x7fe620001490 con 0x7fe62415c020 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe62973f640 1 --2- 172.21.15.143:0/4233027489 >> v2:172.21.15.163:3300/0 conn(0x7fe6240ae180 0x7fe6240b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe610003520 con 0x7fe62415c020 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3516421294 0 0) 0x7fe610003520 con 0x7fe62415c020 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 >> v2:172.21.15.163:3300/0 conn(0x7fe6240ae180 msgr2=0x7fe6240b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 --2- 172.21.15.143:0/4233027489 >> v2:172.21.15.163:3300/0 conn(0x7fe6240ae180 0x7fe6240b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 >> v1:172.21.15.163:6789/0 conn(0x7fe6240b46e0 legacy=0x7fe6240afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe624074710 con 0x7fe62415c020 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7fe620001c40 con 0x7fe62415c020 2024-05-08T10:24:36.720 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 >> v1:172.21.15.143:6789/0 conn(0x7fe62415c020 legacy=0x7fe624073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe610003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe610004800 0x7fe610004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe6100053c0 0x7fe61000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe6240ae700 con 0x7fe610003a50 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe61000c230 con 0x7fe610004800 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe61000c430 con 0x7fe6100053c0 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe629f40640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe610003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe62973f640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe610004800 0x7fe610004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe62a741640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe6100053c0 0x7fe61000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe629f40640 1 -- 172.21.15.143:0/4233027489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe6100053c0 msgr2=0x7fe61000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe629f40640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe6100053c0 0x7fe61000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe629f40640 1 -- 172.21.15.143:0/4233027489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe610004800 msgr2=0x7fe610004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe629f40640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe610004800 0x7fe610004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe62a741640 1 -- 172.21.15.143:0/4233027489 reap_dead start 2024-05-08T10:24:36.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.733+0000 7fe629f40640 1 -- 172.21.15.143:0/4233027489 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe610003520 con 0x7fe610003a50 2024-05-08T10:24:36.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.734+0000 7fe629f40640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe610003e70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe62000aa00 tx=0x7fe610005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c2558111ee634b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:36.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.734+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62000a650 con 0x7fe610003a50 2024-05-08T10:24:36.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.734+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62002f070 con 0x7fe610003a50 2024-05-08T10:24:36.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.734+0000 7fe628f3e640 1 -- 172.21.15.143:0/4233027489 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62002bdc0 con 0x7fe610003a50 2024-05-08T10:24:36.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.735+0000 7fe62c1a4640 1 -- 172.21.15.143:0/4233027489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 msgr2=0x7fe610003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:36.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.735+0000 7fe62c1a4640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe610003e70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe62000aa00 tx=0x7fe610005830 comp rx=0 tx=0).stop 2024-05-08T10:24:36.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.735+0000 7fe62c1a4640 1 -- 172.21.15.143:0/4233027489 shutdown_connections 2024-05-08T10:24:36.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.735+0000 7fe62c1a4640 1 --2- 172.21.15.143:0/4233027489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe610003e70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.735+0000 7fe62c1a4640 1 -- 172.21.15.143:0/4233027489 >> 172.21.15.143:0/4233027489 conn(0x7fe62406c500 msgr2=0x7fe62406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.735+0000 7fe62c1a4640 1 -- 172.21.15.143:0/4233027489 shutdown_connections 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.735+0000 7fe62c1a4640 1 -- 172.21.15.143:0/4233027489 wait complete. 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.736+0000 7fe62c1a4640 1 Processor -- start 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.736+0000 7fe62c1a4640 1 -- start start 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe62c1a4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe62406fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe62c1a4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe62409d4a0 0x7fe6241f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe62c1a4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6240afbc0 0x7fe6240b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe62c1a4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe62415c400 con 0x7fe610003a50 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe62c1a4640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe624073290 con 0x7fe6240afbc0 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe62c1a4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fe6240b4b70 con 0x7fe62409d4a0 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe629f40640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe62406fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe629f40640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe62406fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55676/0 (socket says 172.21.15.143:55676) 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe629f40640 1 -- 172.21.15.143:0/3476805249 learned_addr learned my addr 172.21.15.143:0/3476805249 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:36.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe629f40640 1 -- 172.21.15.143:0/3476805249 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe62409d4a0 msgr2=0x7fe6241f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe629f40640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe62409d4a0 0x7fe6241f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe629f40640 1 -- 172.21.15.143:0/3476805249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6240afbc0 msgr2=0x7fe6240b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe62a741640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6240afbc0 0x7fe6240b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe629f40640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6240afbc0 0x7fe6240b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe629f40640 1 -- 172.21.15.143:0/3476805249 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62409dc10 con 0x7fe610003a50 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.737+0000 7fe62a741640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6240afbc0 0x7fe6240b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.738+0000 7fe629f40640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe62406fb40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe62000aaf0 tx=0x7fe6240b0da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.738+0000 7fe61a7fc640 1 -- 172.21.15.143:0/3476805249 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620038030 con 0x7fe610003a50 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.738+0000 7fe61a7fc640 1 -- 172.21.15.143:0/3476805249 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62002b980 con 0x7fe610003a50 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.738+0000 7fe61a7fc640 1 -- 172.21.15.143:0/3476805249 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62002bd30 con 0x7fe610003a50 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.738+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62409def0 con 0x7fe610003a50 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.738+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62409e4b0 con 0x7fe610003a50 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.739+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62406a550 con 0x7fe610003a50 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.739+0000 7fe61a7fc640 1 -- 172.21.15.143:0/3476805249 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe620034470 con 0x7fe610003a50 2024-05-08T10:24:36.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.740+0000 7fe61a7fc640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe6080762d0 0x7fe608078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:36.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.740+0000 7fe61a7fc640 1 -- 172.21.15.143:0/3476805249 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe6200b7660 con 0x7fe610003a50 2024-05-08T10:24:36.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.740+0000 7fe62973f640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe6080762d0 0x7fe608078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:36.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.740+0000 7fe62973f640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe6080762d0 0x7fe608078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe614006e80 tx=0x7fe614006df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:36.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.744+0000 7fe61a7fc640 1 -- 172.21.15.143:0/3476805249 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe624072f80 con 0x7fe610003a50 2024-05-08T10:24:36.904 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.919+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6240b0580 con 0x7fe6080762d0 2024-05-08T10:24:36.910 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.925+0000 7fe61a7fc640 1 -- 172.21.15.143:0/3476805249 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7fe614004030 con 0x7fe6080762d0 2024-05-08T10:24:36.913 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:36.914 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.928+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe6080762d0 msgr2=0x7fe608078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.928+0000 7fe62c1a4640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe6080762d0 0x7fe608078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe614006e80 tx=0x7fe614006df0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.928+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 msgr2=0x7fe62406fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.928+0000 7fe62c1a4640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe62406fb40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe62000aaf0 tx=0x7fe6240b0da0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.929+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 shutdown_connections 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.929+0000 7fe62c1a4640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6240afbc0 0x7fe6240b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.929+0000 7fe62c1a4640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe62409d4a0 0x7fe6241f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.929+0000 7fe62c1a4640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fe6080762d0 0x7fe608078790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.929+0000 7fe62c1a4640 1 --2- 172.21.15.143:0/3476805249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe610003a50 0x7fe62406fb40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.929+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 >> 172.21.15.143:0/3476805249 conn(0x7fe62406c500 msgr2=0x7fe6240b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.929+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 shutdown_connections 2024-05-08T10:24:36.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:36.929+0000 7fe62c1a4640 1 -- 172.21.15.143:0/3476805249 wait complete. 2024-05-08T10:24:36.925 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-05-08T10:24:36.533332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220136,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754584,"statfs":{"total":773094113280,"available":772868694016,"internally_reserved":0,"allocated":4038656,"data_stored":2258564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001457"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.676293+0000","last_change":"2024-05-08T10:24:29.212726+0000","last_active":"2024-05-08T10:24:30.676293+0000","last_peered":"2024-05-08T10:24:30.676293+0000","last_clean":"2024-05-08T10:24:30.676293+0000","last_became_active":"2024-05-08T10:24:29.212410+0000","last_became_peered":"2024-05-08T10:24:29.212410+0000","last_unstale":"2024-05-08T10:24:30.676293+0000","last_undegraded":"2024-05-08T10:24:30.676293+0000","last_fullsized":"2024-05-08T10:24:30.676293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:20.796051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202686+0000","last_change":"2024-05-08T10:24:29.205908+0000","last_active":"2024-05-08T10:24:30.202686+0000","last_peered":"2024-05-08T10:24:30.202686+0000","last_clean":"2024-05-08T10:24:30.202686+0000","last_became_active":"2024-05-08T10:24:29.205593+0000","last_became_peered":"2024-05-08T10:24:29.205593+0000","last_unstale":"2024-05-08T10:24:30.202686+0000","last_undegraded":"2024-05-08T10:24:30.202686+0000","last_fullsized":"2024-05-08T10:24:30.202686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:57:25.964405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876093+0000","last_change":"2024-05-08T10:24:29.220689+0000","last_active":"2024-05-08T10:24:30.876093+0000","last_peered":"2024-05-08T10:24:30.876093+0000","last_clean":"2024-05-08T10:24:30.876093+0000","last_became_active":"2024-05-08T10:24:29.220187+0000","last_became_peered":"2024-05-08T10:24:29.220187+0000","last_unstale":"2024-05-08T10:24:30.876093+0000","last_undegraded":"2024-05-08T10:24:30.876093+0000","last_fullsized":"2024-05-08T10:24:30.876093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:58.088107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876084+0000","last_change":"2024-05-08T10:24:29.223061+0000","last_active":"2024-05-08T10:24:30.876084+0000","last_peered":"2024-05-08T10:24:30.876084+0000","last_clean":"2024-05-08T10:24:30.876084+0000","last_became_active":"2024-05-08T10:24:29.222146+0000","last_became_peered":"2024-05-08T10:24:29.222146+0000","last_unstale":"2024-05-08T10:24:30.876084+0000","last_undegraded":"2024-05-08T10:24:30.876084+0000","last_fullsized":"2024-05-08T10:24:30.876084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:17.147604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.201865+0000","last_change":"2024-05-08T10:24:29.213534+0000","last_active":"2024-05-08T10:24:30.201865+0000","last_peered":"2024-05-08T10:24:30.201865+0000","last_clean":"2024-05-08T10:24:30.201865+0000","last_became_active":"2024-05-08T10:24:29.213235+0000","last_became_peered":"2024-05-08T10:24:29.213235+0000","last_unstale":"2024-05-08T10:24:30.201865+0000","last_undegraded":"2024-05-08T10:24:30.201865+0000","last_fullsized":"2024-05-08T10:24:30.201865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:02:39.049971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.201947+0000","last_change":"2024-05-08T10:24:29.211156+0000","last_active":"2024-05-08T10:24:30.201947+0000","last_peered":"2024-05-08T10:24:30.201947+0000","last_clean":"2024-05-08T10:24:30.201947+0000","last_became_active":"2024-05-08T10:24:29.210733+0000","last_became_peered":"2024-05-08T10:24:29.210733+0000","last_unstale":"2024-05-08T10:24:30.201947+0000","last_undegraded":"2024-05-08T10:24:30.201947+0000","last_fullsized":"2024-05-08T10:24:30.201947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:19.505068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375350+0000","last_change":"2024-05-08T10:24:29.210243+0000","last_active":"2024-05-08T10:24:30.375350+0000","last_peered":"2024-05-08T10:24:30.375350+0000","last_clean":"2024-05-08T10:24:30.375350+0000","last_became_active":"2024-05-08T10:24:29.209848+0000","last_became_peered":"2024-05-08T10:24:29.209848+0000","last_unstale":"2024-05-08T10:24:30.375350+0000","last_undegraded":"2024-05-08T10:24:30.375350+0000","last_fullsized":"2024-05-08T10:24:30.375350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:19.505068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.374948+0000","last_change":"2024-05-08T10:24:29.211942+0000","last_active":"2024-05-08T10:24:30.374948+0000","last_peered":"2024-05-08T10:24:30.374948+0000","last_clean":"2024-05-08T10:24:30.374948+0000","last_became_active":"2024-05-08T10:24:29.211669+0000","last_became_peered":"2024-05-08T10:24:29.211669+0000","last_unstale":"2024-05-08T10:24:30.374948+0000","last_undegraded":"2024-05-08T10:24:30.374948+0000","last_fullsized":"2024-05-08T10:24:30.374948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:17.147604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202617+0000","last_change":"2024-05-08T10:24:29.216114+0000","last_active":"2024-05-08T10:24:30.202617+0000","last_peered":"2024-05-08T10:24:30.202617+0000","last_clean":"2024-05-08T10:24:30.202617+0000","last_became_active":"2024-05-08T10:24:29.215791+0000","last_became_peered":"2024-05-08T10:24:29.215791+0000","last_unstale":"2024-05-08T10:24:30.202617+0000","last_undegraded":"2024-05-08T10:24:30.202617+0000","last_fullsized":"2024-05-08T10:24:30.202617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:20.796051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876017+0000","last_change":"2024-05-08T10:24:29.219195+0000","last_active":"2024-05-08T10:24:30.876017+0000","last_peered":"2024-05-08T10:24:30.876017+0000","last_clean":"2024-05-08T10:24:30.876017+0000","last_became_active":"2024-05-08T10:24:29.218955+0000","last_became_peered":"2024-05-08T10:24:29.218955+0000","last_unstale":"2024-05-08T10:24:30.876017+0000","last_undegraded":"2024-05-08T10:24:30.876017+0000","last_fullsized":"2024-05-08T10:24:30.876017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:21:44.478767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375284+0000","last_change":"2024-05-08T10:24:29.216509+0000","last_active":"2024-05-08T10:24:30.375284+0000","last_peered":"2024-05-08T10:24:30.375284+0000","last_clean":"2024-05-08T10:24:30.375284+0000","last_became_active":"2024-05-08T10:24:29.216075+0000","last_became_peered":"2024-05-08T10:24:29.216075+0000","last_unstale":"2024-05-08T10:24:30.375284+0000","last_undegraded":"2024-05-08T10:24:30.375284+0000","last_fullsized":"2024-05-08T10:24:30.375284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:33.023158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875979+0000","last_change":"2024-05-08T10:24:29.220891+0000","last_active":"2024-05-08T10:24:30.875979+0000","last_peered":"2024-05-08T10:24:30.875979+0000","last_clean":"2024-05-08T10:24:30.875979+0000","last_became_active":"2024-05-08T10:24:29.220569+0000","last_became_peered":"2024-05-08T10:24:29.220569+0000","last_unstale":"2024-05-08T10:24:30.875979+0000","last_undegraded":"2024-05-08T10:24:30.875979+0000","last_fullsized":"2024-05-08T10:24:30.875979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:30:28.885131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202018+0000","last_change":"2024-05-08T10:24:29.214957+0000","last_active":"2024-05-08T10:24:30.202018+0000","last_peered":"2024-05-08T10:24:30.202018+0000","last_clean":"2024-05-08T10:24:30.202018+0000","last_became_active":"2024-05-08T10:24:29.214705+0000","last_became_peered":"2024-05-08T10:24:29.214705+0000","last_unstale":"2024-05-08T10:24:30.202018+0000","last_undegraded":"2024-05-08T10:24:30.202018+0000","last_fullsized":"2024-05-08T10:24:30.202018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:29.993514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202081+0000","last_change":"2024-05-08T10:24:29.199041+0000","last_active":"2024-05-08T10:24:30.202081+0000","last_peered":"2024-05-08T10:24:30.202081+0000","last_clean":"2024-05-08T10:24:30.202081+0000","last_became_active":"2024-05-08T10:24:29.198647+0000","last_became_peered":"2024-05-08T10:24:29.198647+0000","last_unstale":"2024-05-08T10:24:30.202081+0000","last_undegraded":"2024-05-08T10:24:30.202081+0000","last_fullsized":"2024-05-08T10:24:30.202081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:21.604096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875917+0000","last_change":"2024-05-08T10:24:29.209856+0000","last_active":"2024-05-08T10:24:30.875917+0000","last_peered":"2024-05-08T10:24:30.875917+0000","last_clean":"2024-05-08T10:24:30.875917+0000","last_became_active":"2024-05-08T10:24:29.209570+0000","last_became_peered":"2024-05-08T10:24:29.209570+0000","last_unstale":"2024-05-08T10:24:30.875917+0000","last_undegraded":"2024-05-08T10:24:30.875917+0000","last_fullsized":"2024-05-08T10:24:30.875917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:56.209465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375343+0000","last_change":"2024-05-08T10:24:29.213298+0000","last_active":"2024-05-08T10:24:30.375343+0000","last_peered":"2024-05-08T10:24:30.375343+0000","last_clean":"2024-05-08T10:24:30.375343+0000","last_became_active":"2024-05-08T10:24:29.212971+0000","last_became_peered":"2024-05-08T10:24:29.212971+0000","last_unstale":"2024-05-08T10:24:30.375343+0000","last_undegraded":"2024-05-08T10:24:30.375343+0000","last_fullsized":"2024-05-08T10:24:30.375343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:59.898248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375483+0000","last_change":"2024-05-08T10:24:29.209806+0000","last_active":"2024-05-08T10:24:30.375483+0000","last_peered":"2024-05-08T10:24:30.375483+0000","last_clean":"2024-05-08T10:24:30.375483+0000","last_became_active":"2024-05-08T10:24:29.209298+0000","last_became_peered":"2024-05-08T10:24:29.209298+0000","last_unstale":"2024-05-08T10:24:30.375483+0000","last_undegraded":"2024-05-08T10:24:30.375483+0000","last_fullsized":"2024-05-08T10:24:30.375483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:21.604096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202820+0000","last_change":"2024-05-08T10:24:29.218241+0000","last_active":"2024-05-08T10:24:30.202820+0000","last_peered":"2024-05-08T10:24:30.202820+0000","last_clean":"2024-05-08T10:24:30.202820+0000","last_became_active":"2024-05-08T10:24:29.218002+0000","last_became_peered":"2024-05-08T10:24:29.218002+0000","last_unstale":"2024-05-08T10:24:30.202820+0000","last_undegraded":"2024-05-08T10:24:30.202820+0000","last_fullsized":"2024-05-08T10:24:30.202820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:48:28.793886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202505+0000","last_change":"2024-05-08T10:24:29.217181+0000","last_active":"2024-05-08T10:24:30.202505+0000","last_peered":"2024-05-08T10:24:30.202505+0000","last_clean":"2024-05-08T10:24:30.202505+0000","last_became_active":"2024-05-08T10:24:29.216901+0000","last_became_peered":"2024-05-08T10:24:29.216901+0000","last_unstale":"2024-05-08T10:24:30.202505+0000","last_undegraded":"2024-05-08T10:24:30.202505+0000","last_fullsized":"2024-05-08T10:24:30.202505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:00.597735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202424+0000","last_change":"2024-05-08T10:24:29.215911+0000","last_active":"2024-05-08T10:24:30.202424+0000","last_peered":"2024-05-08T10:24:30.202424+0000","last_clean":"2024-05-08T10:24:30.202424+0000","last_became_active":"2024-05-08T10:24:29.215663+0000","last_became_peered":"2024-05-08T10:24:29.215663+0000","last_unstale":"2024-05-08T10:24:30.202424+0000","last_undegraded":"2024-05-08T10:24:30.202424+0000","last_fullsized":"2024-05-08T10:24:30.202424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:07:21.211146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202895+0000","last_change":"2024-05-08T10:24:29.205553+0000","last_active":"2024-05-08T10:24:30.202895+0000","last_peered":"2024-05-08T10:24:30.202895+0000","last_clean":"2024-05-08T10:24:30.202895+0000","last_became_active":"2024-05-08T10:24:29.205280+0000","last_became_peered":"2024-05-08T10:24:29.205280+0000","last_unstale":"2024-05-08T10:24:30.202895+0000","last_undegraded":"2024-05-08T10:24:30.202895+0000","last_fullsized":"2024-05-08T10:24:30.202895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:29.977801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202387+0000","last_change":"2024-05-08T10:24:29.200973+0000","last_active":"2024-05-08T10:24:30.202387+0000","last_peered":"2024-05-08T10:24:30.202387+0000","last_clean":"2024-05-08T10:24:30.202387+0000","last_became_active":"2024-05-08T10:24:29.199214+0000","last_became_peered":"2024-05-08T10:24:29.199214+0000","last_unstale":"2024-05-08T10:24:30.202387+0000","last_undegraded":"2024-05-08T10:24:30.202387+0000","last_fullsized":"2024-05-08T10:24:30.202387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:33.963829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875699+0000","last_change":"2024-05-08T10:24:29.212660+0000","last_active":"2024-05-08T10:24:30.875699+0000","last_peered":"2024-05-08T10:24:30.875699+0000","last_clean":"2024-05-08T10:24:30.875699+0000","last_became_active":"2024-05-08T10:24:29.212395+0000","last_became_peered":"2024-05-08T10:24:29.212395+0000","last_unstale":"2024-05-08T10:24:30.875699+0000","last_undegraded":"2024-05-08T10:24:30.875699+0000","last_fullsized":"2024-05-08T10:24:30.875699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:33.963829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876136+0000","last_change":"2024-05-08T10:24:29.211152+0000","last_active":"2024-05-08T10:24:30.876136+0000","last_peered":"2024-05-08T10:24:30.876136+0000","last_clean":"2024-05-08T10:24:30.876136+0000","last_became_active":"2024-05-08T10:24:29.210851+0000","last_became_peered":"2024-05-08T10:24:29.210851+0000","last_unstale":"2024-05-08T10:24:30.876136+0000","last_undegraded":"2024-05-08T10:24:30.876136+0000","last_fullsized":"2024-05-08T10:24:30.876136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:33.023158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876489+0000","last_change":"2024-05-08T10:24:29.218903+0000","last_active":"2024-05-08T10:24:30.876489+0000","last_peered":"2024-05-08T10:24:30.876489+0000","last_clean":"2024-05-08T10:24:30.876489+0000","last_became_active":"2024-05-08T10:24:29.218627+0000","last_became_peered":"2024-05-08T10:24:29.218627+0000","last_unstale":"2024-05-08T10:24:30.876489+0000","last_undegraded":"2024-05-08T10:24:30.876489+0000","last_fullsized":"2024-05-08T10:24:30.876489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:16:22.156519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202831+0000","last_change":"2024-05-08T10:24:29.207048+0000","last_active":"2024-05-08T10:24:30.202831+0000","last_peered":"2024-05-08T10:24:30.202831+0000","last_clean":"2024-05-08T10:24:30.202831+0000","last_became_active":"2024-05-08T10:24:29.206780+0000","last_became_peered":"2024-05-08T10:24:29.206780+0000","last_unstale":"2024-05-08T10:24:30.202831+0000","last_undegraded":"2024-05-08T10:24:30.202831+0000","last_fullsized":"2024-05-08T10:24:30.202831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:25.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876466+0000","last_change":"2024-05-08T10:24:29.222408+0000","last_active":"2024-05-08T10:24:30.876466+0000","last_peered":"2024-05-08T10:24:30.876466+0000","last_clean":"2024-05-08T10:24:30.876466+0000","last_became_active":"2024-05-08T10:24:29.222006+0000","last_became_peered":"2024-05-08T10:24:29.222006+0000","last_unstale":"2024-05-08T10:24:30.876466+0000","last_undegraded":"2024-05-08T10:24:30.876466+0000","last_fullsized":"2024-05-08T10:24:30.876466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:30:28.885131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876151+0000","last_change":"2024-05-08T10:24:29.215046+0000","last_active":"2024-05-08T10:24:30.876151+0000","last_peered":"2024-05-08T10:24:30.876151+0000","last_clean":"2024-05-08T10:24:30.876151+0000","last_became_active":"2024-05-08T10:24:29.214734+0000","last_became_peered":"2024-05-08T10:24:29.214734+0000","last_unstale":"2024-05-08T10:24:30.876151+0000","last_undegraded":"2024-05-08T10:24:30.876151+0000","last_fullsized":"2024-05-08T10:24:30.876151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:46.041093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202744+0000","last_change":"2024-05-08T10:24:29.199799+0000","last_active":"2024-05-08T10:24:30.202744+0000","last_peered":"2024-05-08T10:24:30.202744+0000","last_clean":"2024-05-08T10:24:30.202744+0000","last_became_active":"2024-05-08T10:24:29.199275+0000","last_became_peered":"2024-05-08T10:24:29.199275+0000","last_unstale":"2024-05-08T10:24:30.202744+0000","last_undegraded":"2024-05-08T10:24:30.202744+0000","last_fullsized":"2024-05-08T10:24:30.202744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:06.428241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375144+0000","last_change":"2024-05-08T10:24:29.209501+0000","last_active":"2024-05-08T10:24:30.375144+0000","last_peered":"2024-05-08T10:24:30.375144+0000","last_clean":"2024-05-08T10:24:30.375144+0000","last_became_active":"2024-05-08T10:24:29.208628+0000","last_became_peered":"2024-05-08T10:24:29.208628+0000","last_unstale":"2024-05-08T10:24:30.375144+0000","last_undegraded":"2024-05-08T10:24:30.375144+0000","last_fullsized":"2024-05-08T10:24:30.375144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:16:22.156519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.676152+0000","last_change":"2024-05-08T10:24:29.207108+0000","last_active":"2024-05-08T10:24:30.676152+0000","last_peered":"2024-05-08T10:24:30.676152+0000","last_clean":"2024-05-08T10:24:30.676152+0000","last_became_active":"2024-05-08T10:24:29.206814+0000","last_became_peered":"2024-05-08T10:24:29.206814+0000","last_unstale":"2024-05-08T10:24:30.676152+0000","last_undegraded":"2024-05-08T10:24:30.676152+0000","last_fullsized":"2024-05-08T10:24:30.676152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:17.261271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.374997+0000","last_change":"2024-05-08T10:24:29.210228+0000","last_active":"2024-05-08T10:24:30.374997+0000","last_peered":"2024-05-08T10:24:30.374997+0000","last_clean":"2024-05-08T10:24:30.374997+0000","last_became_active":"2024-05-08T10:24:29.209117+0000","last_became_peered":"2024-05-08T10:24:29.209117+0000","last_unstale":"2024-05-08T10:24:30.374997+0000","last_undegraded":"2024-05-08T10:24:30.374997+0000","last_fullsized":"2024-05-08T10:24:30.374997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:56.209465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875969+0000","last_change":"2024-05-08T10:24:29.209672+0000","last_active":"2024-05-08T10:24:30.875969+0000","last_peered":"2024-05-08T10:24:30.875969+0000","last_clean":"2024-05-08T10:24:30.875969+0000","last_became_active":"2024-05-08T10:24:29.209411+0000","last_became_peered":"2024-05-08T10:24:29.209411+0000","last_unstale":"2024-05-08T10:24:30.875969+0000","last_undegraded":"2024-05-08T10:24:30.875969+0000","last_fullsized":"2024-05-08T10:24:30.875969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:06.428241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.676333+0000","last_change":"2024-05-08T10:24:28.206909+0000","last_active":"2024-05-08T10:24:30.676333+0000","last_peered":"2024-05-08T10:24:30.676333+0000","last_clean":"2024-05-08T10:24:30.676333+0000","last_became_active":"2024-05-08T10:24:28.206615+0000","last_became_peered":"2024-05-08T10:24:28.206615+0000","last_unstale":"2024-05-08T10:24:30.676333+0000","last_undegraded":"2024-05-08T10:24:30.676333+0000","last_fullsized":"2024-05-08T10:24:30.676333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:52.545489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.676359+0000","last_change":"2024-05-08T10:24:29.205731+0000","last_active":"2024-05-08T10:24:30.676359+0000","last_peered":"2024-05-08T10:24:30.676359+0000","last_clean":"2024-05-08T10:24:30.676359+0000","last_became_active":"2024-05-08T10:24:29.205458+0000","last_became_peered":"2024-05-08T10:24:29.205458+0000","last_unstale":"2024-05-08T10:24:30.676359+0000","last_undegraded":"2024-05-08T10:24:30.676359+0000","last_fullsized":"2024-05-08T10:24:30.676359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:20.706863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876018+0000","last_change":"2024-05-08T10:24:28.209639+0000","last_active":"2024-05-08T10:24:30.876018+0000","last_peered":"2024-05-08T10:24:30.876018+0000","last_clean":"2024-05-08T10:24:30.876018+0000","last_became_active":"2024-05-08T10:24:28.209377+0000","last_became_peered":"2024-05-08T10:24:28.209377+0000","last_unstale":"2024-05-08T10:24:30.876018+0000","last_undegraded":"2024-05-08T10:24:30.876018+0000","last_fullsized":"2024-05-08T10:24:30.876018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:52.545489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202780+0000","last_change":"2024-05-08T10:24:29.202362+0000","last_active":"2024-05-08T10:24:30.202780+0000","last_peered":"2024-05-08T10:24:30.202780+0000","last_clean":"2024-05-08T10:24:30.202780+0000","last_became_active":"2024-05-08T10:24:29.201835+0000","last_became_peered":"2024-05-08T10:24:29.201835+0000","last_unstale":"2024-05-08T10:24:30.202780+0000","last_undegraded":"2024-05-08T10:24:30.202780+0000","last_fullsized":"2024-05-08T10:24:30.202780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:50.999849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202533+0000","last_change":"2024-05-08T10:24:28.212178+0000","last_active":"2024-05-08T10:24:30.202533+0000","last_peered":"2024-05-08T10:24:30.202533+0000","last_clean":"2024-05-08T10:24:30.202533+0000","last_became_active":"2024-05-08T10:24:28.211916+0000","last_became_peered":"2024-05-08T10:24:28.211916+0000","last_unstale":"2024-05-08T10:24:30.202533+0000","last_undegraded":"2024-05-08T10:24:30.202533+0000","last_fullsized":"2024-05-08T10:24:30.202533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:05.423688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876495+0000","last_change":"2024-05-08T10:24:29.215744+0000","last_active":"2024-05-08T10:24:30.876495+0000","last_peered":"2024-05-08T10:24:30.876495+0000","last_clean":"2024-05-08T10:24:30.876495+0000","last_became_active":"2024-05-08T10:24:29.215507+0000","last_became_peered":"2024-05-08T10:24:29.215507+0000","last_unstale":"2024-05-08T10:24:30.876495+0000","last_undegraded":"2024-05-08T10:24:30.876495+0000","last_fullsized":"2024-05-08T10:24:30.876495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:43:12.214276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202331+0000","last_change":"2024-05-08T10:24:28.199572+0000","last_active":"2024-05-08T10:24:30.202331+0000","last_peered":"2024-05-08T10:24:30.202331+0000","last_clean":"2024-05-08T10:24:30.202331+0000","last_became_active":"2024-05-08T10:24:28.199277+0000","last_became_peered":"2024-05-08T10:24:28.199277+0000","last_unstale":"2024-05-08T10:24:30.202331+0000","last_undegraded":"2024-05-08T10:24:30.202331+0000","last_fullsized":"2024-05-08T10:24:30.202331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:57.382597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375087+0000","last_change":"2024-05-08T10:24:29.209913+0000","last_active":"2024-05-08T10:24:30.375087+0000","last_peered":"2024-05-08T10:24:30.375087+0000","last_clean":"2024-05-08T10:24:30.375087+0000","last_became_active":"2024-05-08T10:24:29.209613+0000","last_became_peered":"2024-05-08T10:24:29.209613+0000","last_unstale":"2024-05-08T10:24:30.375087+0000","last_undegraded":"2024-05-08T10:24:30.375087+0000","last_fullsized":"2024-05-08T10:24:30.375087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:30:28.885131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202803+0000","last_change":"2024-05-08T10:24:28.212680+0000","last_active":"2024-05-08T10:24:30.202803+0000","last_peered":"2024-05-08T10:24:30.202803+0000","last_clean":"2024-05-08T10:24:30.202803+0000","last_became_active":"2024-05-08T10:24:28.212310+0000","last_became_peered":"2024-05-08T10:24:28.212310+0000","last_unstale":"2024-05-08T10:24:30.202803+0000","last_undegraded":"2024-05-08T10:24:30.202803+0000","last_fullsized":"2024-05-08T10:24:30.202803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:01.005597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876058+0000","last_change":"2024-05-08T10:24:29.215111+0000","last_active":"2024-05-08T10:24:30.876058+0000","last_peered":"2024-05-08T10:24:30.876058+0000","last_clean":"2024-05-08T10:24:30.876058+0000","last_became_active":"2024-05-08T10:24:29.214810+0000","last_became_peered":"2024-05-08T10:24:29.214810+0000","last_unstale":"2024-05-08T10:24:30.876058+0000","last_undegraded":"2024-05-08T10:24:30.876058+0000","last_fullsized":"2024-05-08T10:24:30.876058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:43:12.214276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202737+0000","last_change":"2024-05-08T10:24:28.207703+0000","last_active":"2024-05-08T10:24:30.202737+0000","last_peered":"2024-05-08T10:24:30.202737+0000","last_clean":"2024-05-08T10:24:30.202737+0000","last_became_active":"2024-05-08T10:24:28.207168+0000","last_became_peered":"2024-05-08T10:24:28.207168+0000","last_unstale":"2024-05-08T10:24:30.202737+0000","last_undegraded":"2024-05-08T10:24:30.202737+0000","last_fullsized":"2024-05-08T10:24:30.202737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:08.271467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202218+0000","last_change":"2024-05-08T10:24:29.207927+0000","last_active":"2024-05-08T10:24:30.202218+0000","last_peered":"2024-05-08T10:24:30.202218+0000","last_clean":"2024-05-08T10:24:30.202218+0000","last_became_active":"2024-05-08T10:24:29.207577+0000","last_became_peered":"2024-05-08T10:24:29.207577+0000","last_unstale":"2024-05-08T10:24:30.202218+0000","last_undegraded":"2024-05-08T10:24:30.202218+0000","last_fullsized":"2024-05-08T10:24:30.202218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:17.261271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.201637+0000","last_change":"2024-05-08T10:24:28.208358+0000","last_active":"2024-05-08T10:24:30.201637+0000","last_peered":"2024-05-08T10:24:30.201637+0000","last_clean":"2024-05-08T10:24:30.201637+0000","last_became_active":"2024-05-08T10:24:28.208088+0000","last_became_peered":"2024-05-08T10:24:28.208088+0000","last_unstale":"2024-05-08T10:24:30.201637+0000","last_undegraded":"2024-05-08T10:24:30.201637+0000","last_fullsized":"2024-05-08T10:24:30.201637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:32.959276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875871+0000","last_change":"2024-05-08T10:24:29.214713+0000","last_active":"2024-05-08T10:24:30.875871+0000","last_peered":"2024-05-08T10:24:30.875871+0000","last_clean":"2024-05-08T10:24:30.875871+0000","last_became_active":"2024-05-08T10:24:29.214440+0000","last_became_peered":"2024-05-08T10:24:29.214440+0000","last_unstale":"2024-05-08T10:24:30.875871+0000","last_undegraded":"2024-05-08T10:24:30.875871+0000","last_fullsized":"2024-05-08T10:24:30.875871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:50.999849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202105+0000","last_change":"2024-05-08T10:24:28.209722+0000","last_active":"2024-05-08T10:24:30.202105+0000","last_peered":"2024-05-08T10:24:30.202105+0000","last_clean":"2024-05-08T10:24:30.202105+0000","last_became_active":"2024-05-08T10:24:28.208161+0000","last_became_peered":"2024-05-08T10:24:28.208161+0000","last_unstale":"2024-05-08T10:24:30.202105+0000","last_undegraded":"2024-05-08T10:24:30.202105+0000","last_fullsized":"2024-05-08T10:24:30.202105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:56.381755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876309+0000","last_change":"2024-05-08T10:24:29.221179+0000","last_active":"2024-05-08T10:24:30.876309+0000","last_peered":"2024-05-08T10:24:30.876309+0000","last_clean":"2024-05-08T10:24:30.876309+0000","last_became_active":"2024-05-08T10:24:29.220850+0000","last_became_peered":"2024-05-08T10:24:29.220850+0000","last_unstale":"2024-05-08T10:24:30.876309+0000","last_undegraded":"2024-05-08T10:24:30.876309+0000","last_fullsized":"2024-05-08T10:24:30.876309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:59.898248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202791+0000","last_change":"2024-05-08T10:24:28.212436+0000","last_active":"2024-05-08T10:24:30.202791+0000","last_peered":"2024-05-08T10:24:30.202791+0000","last_clean":"2024-05-08T10:24:30.202791+0000","last_became_active":"2024-05-08T10:24:28.212174+0000","last_became_peered":"2024-05-08T10:24:28.212174+0000","last_unstale":"2024-05-08T10:24:30.202791+0000","last_undegraded":"2024-05-08T10:24:30.202791+0000","last_fullsized":"2024-05-08T10:24:30.202791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:19.791498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202643+0000","last_change":"2024-05-08T10:24:29.217842+0000","last_active":"2024-05-08T10:24:30.202643+0000","last_peered":"2024-05-08T10:24:30.202643+0000","last_clean":"2024-05-08T10:24:30.202643+0000","last_became_active":"2024-05-08T10:24:29.217573+0000","last_became_peered":"2024-05-08T10:24:29.217573+0000","last_unstale":"2024-05-08T10:24:30.202643+0000","last_undegraded":"2024-05-08T10:24:30.202643+0000","last_fullsized":"2024-05-08T10:24:30.202643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:23:00.521528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876108+0000","last_change":"2024-05-08T10:24:28.212335+0000","last_active":"2024-05-08T10:24:30.876108+0000","last_peered":"2024-05-08T10:24:30.876108+0000","last_clean":"2024-05-08T10:24:30.876108+0000","last_became_active":"2024-05-08T10:24:28.212091+0000","last_became_peered":"2024-05-08T10:24:28.212091+0000","last_unstale":"2024-05-08T10:24:30.876108+0000","last_undegraded":"2024-05-08T10:24:30.876108+0000","last_fullsized":"2024-05-08T10:24:30.876108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:41.340835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202592+0000","last_change":"2024-05-08T10:24:29.210642+0000","last_active":"2024-05-08T10:24:30.202592+0000","last_peered":"2024-05-08T10:24:30.202592+0000","last_clean":"2024-05-08T10:24:30.202592+0000","last_became_active":"2024-05-08T10:24:29.210381+0000","last_became_peered":"2024-05-08T10:24:29.210381+0000","last_unstale":"2024-05-08T10:24:30.202592+0000","last_undegraded":"2024-05-08T10:24:30.202592+0000","last_fullsized":"2024-05-08T10:24:30.202592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:14.631870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876110+0000","last_change":"2024-05-08T10:24:28.210150+0000","last_active":"2024-05-08T10:24:30.876110+0000","last_peered":"2024-05-08T10:24:30.876110+0000","last_clean":"2024-05-08T10:24:30.876110+0000","last_became_active":"2024-05-08T10:24:28.209865+0000","last_became_peered":"2024-05-08T10:24:28.209865+0000","last_unstale":"2024-05-08T10:24:30.876110+0000","last_undegraded":"2024-05-08T10:24:30.876110+0000","last_fullsized":"2024-05-08T10:24:30.876110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:01.517456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876026+0000","last_change":"2024-05-08T10:24:29.220855+0000","last_active":"2024-05-08T10:24:30.876026+0000","last_peered":"2024-05-08T10:24:30.876026+0000","last_clean":"2024-05-08T10:24:30.876026+0000","last_became_active":"2024-05-08T10:24:29.220553+0000","last_became_peered":"2024-05-08T10:24:29.220553+0000","last_unstale":"2024-05-08T10:24:30.876026+0000","last_undegraded":"2024-05-08T10:24:30.876026+0000","last_fullsized":"2024-05-08T10:24:30.876026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:16:22.156519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202588+0000","last_change":"2024-05-08T10:24:28.213479+0000","last_active":"2024-05-08T10:24:30.202588+0000","last_peered":"2024-05-08T10:24:30.202588+0000","last_clean":"2024-05-08T10:24:30.202588+0000","last_became_active":"2024-05-08T10:24:28.213217+0000","last_became_peered":"2024-05-08T10:24:28.213217+0000","last_unstale":"2024-05-08T10:24:30.202588+0000","last_undegraded":"2024-05-08T10:24:30.202588+0000","last_fullsized":"2024-05-08T10:24:30.202588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:49.995296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875923+0000","last_change":"2024-05-08T10:24:29.216832+0000","last_active":"2024-05-08T10:24:30.875923+0000","last_peered":"2024-05-08T10:24:30.875923+0000","last_clean":"2024-05-08T10:24:30.875923+0000","last_became_active":"2024-05-08T10:24:29.216553+0000","last_became_peered":"2024-05-08T10:24:29.216553+0000","last_unstale":"2024-05-08T10:24:30.875923+0000","last_undegraded":"2024-05-08T10:24:30.875923+0000","last_fullsized":"2024-05-08T10:24:30.875923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:29.977801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202901+0000","last_change":"2024-05-08T10:24:28.206504+0000","last_active":"2024-05-08T10:24:30.202901+0000","last_peered":"2024-05-08T10:24:30.202901+0000","last_clean":"2024-05-08T10:24:30.202901+0000","last_became_active":"2024-05-08T10:24:28.206231+0000","last_became_peered":"2024-05-08T10:24:28.206231+0000","last_unstale":"2024-05-08T10:24:30.202901+0000","last_undegraded":"2024-05-08T10:24:30.202901+0000","last_fullsized":"2024-05-08T10:24:30.202901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:02.741822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202420+0000","last_change":"2024-05-08T10:24:29.206674+0000","last_active":"2024-05-08T10:24:30.202420+0000","last_peered":"2024-05-08T10:24:30.202420+0000","last_clean":"2024-05-08T10:24:30.202420+0000","last_became_active":"2024-05-08T10:24:29.206405+0000","last_became_peered":"2024-05-08T10:24:29.206405+0000","last_unstale":"2024-05-08T10:24:30.202420+0000","last_undegraded":"2024-05-08T10:24:30.202420+0000","last_fullsized":"2024-05-08T10:24:30.202420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:49.310874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875987+0000","last_change":"2024-05-08T10:24:28.206466+0000","last_active":"2024-05-08T10:24:30.875987+0000","last_peered":"2024-05-08T10:24:30.875987+0000","last_clean":"2024-05-08T10:24:30.875987+0000","last_became_active":"2024-05-08T10:24:28.206019+0000","last_became_peered":"2024-05-08T10:24:28.206019+0000","last_unstale":"2024-05-08T10:24:30.875987+0000","last_undegraded":"2024-05-08T10:24:30.875987+0000","last_fullsized":"2024-05-08T10:24:30.875987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:51.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375336+0000","last_change":"2024-05-08T10:24:29.210613+0000","last_active":"2024-05-08T10:24:30.375336+0000","last_peered":"2024-05-08T10:24:30.375336+0000","last_clean":"2024-05-08T10:24:30.375336+0000","last_became_active":"2024-05-08T10:24:29.209304+0000","last_became_peered":"2024-05-08T10:24:29.209304+0000","last_unstale":"2024-05-08T10:24:30.375336+0000","last_undegraded":"2024-05-08T10:24:30.375336+0000","last_fullsized":"2024-05-08T10:24:30.375336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:43:12.214276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202216+0000","last_change":"2024-05-08T10:24:28.210129+0000","last_active":"2024-05-08T10:24:30.202216+0000","last_peered":"2024-05-08T10:24:30.202216+0000","last_clean":"2024-05-08T10:24:30.202216+0000","last_became_active":"2024-05-08T10:24:28.209886+0000","last_became_peered":"2024-05-08T10:24:28.209886+0000","last_unstale":"2024-05-08T10:24:30.202216+0000","last_undegraded":"2024-05-08T10:24:30.202216+0000","last_fullsized":"2024-05-08T10:24:30.202216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:16.256718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.676237+0000","last_change":"2024-05-08T10:24:29.203794+0000","last_active":"2024-05-08T10:24:30.676237+0000","last_peered":"2024-05-08T10:24:30.676237+0000","last_clean":"2024-05-08T10:24:30.676237+0000","last_became_active":"2024-05-08T10:24:29.203085+0000","last_became_peered":"2024-05-08T10:24:29.203085+0000","last_unstale":"2024-05-08T10:24:30.676237+0000","last_undegraded":"2024-05-08T10:24:30.676237+0000","last_fullsized":"2024-05-08T10:24:30.676237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:33.963829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.201680+0000","last_change":"2024-05-08T10:24:28.210599+0000","last_active":"2024-05-08T10:24:30.201680+0000","last_peered":"2024-05-08T10:24:30.201680+0000","last_clean":"2024-05-08T10:24:30.201680+0000","last_became_active":"2024-05-08T10:24:28.210315+0000","last_became_peered":"2024-05-08T10:24:28.210315+0000","last_unstale":"2024-05-08T10:24:30.201680+0000","last_undegraded":"2024-05-08T10:24:30.201680+0000","last_fullsized":"2024-05-08T10:24:30.201680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:34:07.176043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202691+0000","last_change":"2024-05-08T10:24:29.211442+0000","last_active":"2024-05-08T10:24:30.202691+0000","last_peered":"2024-05-08T10:24:30.202691+0000","last_clean":"2024-05-08T10:24:30.202691+0000","last_became_active":"2024-05-08T10:24:29.210863+0000","last_became_peered":"2024-05-08T10:24:29.210863+0000","last_unstale":"2024-05-08T10:24:30.202691+0000","last_undegraded":"2024-05-08T10:24:30.202691+0000","last_fullsized":"2024-05-08T10:24:30.202691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:20.706863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876475+0000","last_change":"2024-05-08T10:24:28.207869+0000","last_active":"2024-05-08T10:24:30.876475+0000","last_peered":"2024-05-08T10:24:30.876475+0000","last_clean":"2024-05-08T10:24:30.876475+0000","last_became_active":"2024-05-08T10:24:28.207590+0000","last_became_peered":"2024-05-08T10:24:28.207590+0000","last_unstale":"2024-05-08T10:24:30.876475+0000","last_undegraded":"2024-05-08T10:24:30.876475+0000","last_fullsized":"2024-05-08T10:24:30.876475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:22.543503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876400+0000","last_change":"2024-05-08T10:24:29.216013+0000","last_active":"2024-05-08T10:24:30.876400+0000","last_peered":"2024-05-08T10:24:30.876400+0000","last_clean":"2024-05-08T10:24:30.876400+0000","last_became_active":"2024-05-08T10:24:29.215640+0000","last_became_peered":"2024-05-08T10:24:29.215640+0000","last_unstale":"2024-05-08T10:24:30.876400+0000","last_undegraded":"2024-05-08T10:24:30.876400+0000","last_fullsized":"2024-05-08T10:24:30.876400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:21.604096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202467+0000","last_change":"2024-05-08T10:24:28.207245+0000","last_active":"2024-05-08T10:24:30.202467+0000","last_peered":"2024-05-08T10:24:30.202467+0000","last_clean":"2024-05-08T10:24:30.202467+0000","last_became_active":"2024-05-08T10:24:28.206945+0000","last_became_peered":"2024-05-08T10:24:28.206945+0000","last_unstale":"2024-05-08T10:24:30.202467+0000","last_undegraded":"2024-05-08T10:24:30.202467+0000","last_fullsized":"2024-05-08T10:24:30.202467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:08:13.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876219+0000","last_change":"2024-05-08T10:24:29.223266+0000","last_active":"2024-05-08T10:24:30.876219+0000","last_peered":"2024-05-08T10:24:30.876219+0000","last_clean":"2024-05-08T10:24:30.876219+0000","last_became_active":"2024-05-08T10:24:29.221109+0000","last_became_peered":"2024-05-08T10:24:29.221109+0000","last_unstale":"2024-05-08T10:24:30.876219+0000","last_undegraded":"2024-05-08T10:24:30.876219+0000","last_fullsized":"2024-05-08T10:24:30.876219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:56.209465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202485+0000","last_change":"2024-05-08T10:24:28.210307+0000","last_active":"2024-05-08T10:24:30.202485+0000","last_peered":"2024-05-08T10:24:30.202485+0000","last_clean":"2024-05-08T10:24:30.202485+0000","last_became_active":"2024-05-08T10:24:28.210002+0000","last_became_peered":"2024-05-08T10:24:28.210002+0000","last_unstale":"2024-05-08T10:24:30.202485+0000","last_undegraded":"2024-05-08T10:24:30.202485+0000","last_fullsized":"2024-05-08T10:24:30.202485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:28.988961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202135+0000","last_change":"2024-05-08T10:24:29.210373+0000","last_active":"2024-05-08T10:24:30.202135+0000","last_peered":"2024-05-08T10:24:30.202135+0000","last_clean":"2024-05-08T10:24:30.202135+0000","last_became_active":"2024-05-08T10:24:29.210040+0000","last_became_peered":"2024-05-08T10:24:29.210040+0000","last_unstale":"2024-05-08T10:24:30.202135+0000","last_undegraded":"2024-05-08T10:24:30.202135+0000","last_fullsized":"2024-05-08T10:24:30.202135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:03.746375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202859+0000","last_change":"2024-05-08T10:24:28.213961+0000","last_active":"2024-05-08T10:24:30.202859+0000","last_peered":"2024-05-08T10:24:30.202859+0000","last_clean":"2024-05-08T10:24:30.202859+0000","last_became_active":"2024-05-08T10:24:28.213641+0000","last_became_peered":"2024-05-08T10:24:28.213641+0000","last_unstale":"2024-05-08T10:24:30.202859+0000","last_undegraded":"2024-05-08T10:24:30.202859+0000","last_fullsized":"2024-05-08T10:24:30.202859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:02:38.045418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.201986+0000","last_change":"2024-05-08T10:24:29.199456+0000","last_active":"2024-05-08T10:24:30.201986+0000","last_peered":"2024-05-08T10:24:30.201986+0000","last_clean":"2024-05-08T10:24:30.201986+0000","last_became_active":"2024-05-08T10:24:29.199198+0000","last_became_peered":"2024-05-08T10:24:29.199198+0000","last_unstale":"2024-05-08T10:24:30.201986+0000","last_undegraded":"2024-05-08T10:24:30.201986+0000","last_fullsized":"2024-05-08T10:24:30.201986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:02.010150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876047+0000","last_change":"2024-05-08T10:24:28.210216+0000","last_active":"2024-05-08T10:24:30.876047+0000","last_peered":"2024-05-08T10:24:30.876047+0000","last_clean":"2024-05-08T10:24:30.876047+0000","last_became_active":"2024-05-08T10:24:28.209960+0000","last_became_peered":"2024-05-08T10:24:28.209960+0000","last_unstale":"2024-05-08T10:24:30.876047+0000","last_undegraded":"2024-05-08T10:24:30.876047+0000","last_fullsized":"2024-05-08T10:24:30.876047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:22.543503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202160+0000","last_change":"2024-05-08T10:24:29.206128+0000","last_active":"2024-05-08T10:24:30.202160+0000","last_peered":"2024-05-08T10:24:30.202160+0000","last_clean":"2024-05-08T10:24:30.202160+0000","last_became_active":"2024-05-08T10:24:29.205870+0000","last_became_peered":"2024-05-08T10:24:29.205870+0000","last_unstale":"2024-05-08T10:24:30.202160+0000","last_undegraded":"2024-05-08T10:24:30.202160+0000","last_fullsized":"2024-05-08T10:24:30.202160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:09.276020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.676187+0000","last_change":"2024-05-08T10:24:28.213273+0000","last_active":"2024-05-08T10:24:30.676187+0000","last_peered":"2024-05-08T10:24:30.676187+0000","last_clean":"2024-05-08T10:24:30.676187+0000","last_became_active":"2024-05-08T10:24:28.212938+0000","last_became_peered":"2024-05-08T10:24:28.212938+0000","last_unstale":"2024-05-08T10:24:30.676187+0000","last_undegraded":"2024-05-08T10:24:30.676187+0000","last_fullsized":"2024-05-08T10:24:30.676187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:38.389474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202140+0000","last_change":"2024-05-08T10:24:29.204983+0000","last_active":"2024-05-08T10:24:30.202140+0000","last_peered":"2024-05-08T10:24:30.202140+0000","last_clean":"2024-05-08T10:24:30.202140+0000","last_became_active":"2024-05-08T10:24:29.204653+0000","last_became_peered":"2024-05-08T10:24:29.204653+0000","last_unstale":"2024-05-08T10:24:30.202140+0000","last_undegraded":"2024-05-08T10:24:30.202140+0000","last_fullsized":"2024-05-08T10:24:30.202140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:29:17.595958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202286+0000","last_change":"2024-05-08T10:24:28.210424+0000","last_active":"2024-05-08T10:24:30.202286+0000","last_peered":"2024-05-08T10:24:30.202286+0000","last_clean":"2024-05-08T10:24:30.202286+0000","last_became_active":"2024-05-08T10:24:28.210150+0000","last_became_peered":"2024-05-08T10:24:28.210150+0000","last_unstale":"2024-05-08T10:24:30.202286+0000","last_undegraded":"2024-05-08T10:24:30.202286+0000","last_fullsized":"2024-05-08T10:24:30.202286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:29:16.591405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375222+0000","last_change":"2024-05-08T10:24:29.209591+0000","last_active":"2024-05-08T10:24:30.375222+0000","last_peered":"2024-05-08T10:24:30.375222+0000","last_clean":"2024-05-08T10:24:30.375222+0000","last_became_active":"2024-05-08T10:24:29.209264+0000","last_became_peered":"2024-05-08T10:24:29.209264+0000","last_unstale":"2024-05-08T10:24:30.375222+0000","last_undegraded":"2024-05-08T10:24:30.375222+0000","last_fullsized":"2024-05-08T10:24:30.375222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:58.088107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875742+0000","last_change":"2024-05-08T10:24:28.210032+0000","last_active":"2024-05-08T10:24:30.875742+0000","last_peered":"2024-05-08T10:24:30.875742+0000","last_clean":"2024-05-08T10:24:30.875742+0000","last_became_active":"2024-05-08T10:24:28.209729+0000","last_became_peered":"2024-05-08T10:24:28.209729+0000","last_unstale":"2024-05-08T10:24:30.875742+0000","last_undegraded":"2024-05-08T10:24:30.875742+0000","last_fullsized":"2024-05-08T10:24:30.875742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:28:59.717350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202065+0000","last_change":"2024-05-08T10:24:29.211282+0000","last_active":"2024-05-08T10:24:30.202065+0000","last_peered":"2024-05-08T10:24:30.202065+0000","last_clean":"2024-05-08T10:24:30.202065+0000","last_became_active":"2024-05-08T10:24:29.210935+0000","last_became_peered":"2024-05-08T10:24:29.210935+0000","last_unstale":"2024-05-08T10:24:30.202065+0000","last_undegraded":"2024-05-08T10:24:30.202065+0000","last_fullsized":"2024-05-08T10:24:30.202065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:08:14.665262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876533+0000","last_change":"2024-05-08T10:24:28.206408+0000","last_active":"2024-05-08T10:24:30.876533+0000","last_peered":"2024-05-08T10:24:30.876533+0000","last_clean":"2024-05-08T10:24:30.876533+0000","last_became_active":"2024-05-08T10:24:28.206094+0000","last_became_peered":"2024-05-08T10:24:28.206094+0000","last_unstale":"2024-05-08T10:24:30.876533+0000","last_undegraded":"2024-05-08T10:24:30.876533+0000","last_fullsized":"2024-05-08T10:24:30.876533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:26:39.623897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876392+0000","last_change":"2024-05-08T10:24:29.216228+0000","last_active":"2024-05-08T10:24:30.876392+0000","last_peered":"2024-05-08T10:24:30.876392+0000","last_clean":"2024-05-08T10:24:30.876392+0000","last_became_active":"2024-05-08T10:24:29.215159+0000","last_became_peered":"2024-05-08T10:24:29.215159+0000","last_unstale":"2024-05-08T10:24:30.876392+0000","last_undegraded":"2024-05-08T10:24:30.876392+0000","last_fullsized":"2024-05-08T10:24:30.876392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:38:19.505068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876230+0000","last_change":"2024-05-08T10:24:28.210832+0000","last_active":"2024-05-08T10:24:30.876230+0000","last_peered":"2024-05-08T10:24:30.876230+0000","last_clean":"2024-05-08T10:24:30.876230+0000","last_became_active":"2024-05-08T10:24:28.210584+0000","last_became_peered":"2024-05-08T10:24:28.210584+0000","last_unstale":"2024-05-08T10:24:30.876230+0000","last_undegraded":"2024-05-08T10:24:30.876230+0000","last_fullsized":"2024-05-08T10:24:30.876230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:51.779870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875779+0000","last_change":"2024-05-08T10:24:29.215418+0000","last_active":"2024-05-08T10:24:30.875779+0000","last_peered":"2024-05-08T10:24:30.875779+0000","last_clean":"2024-05-08T10:24:30.875779+0000","last_became_active":"2024-05-08T10:24:29.215128+0000","last_became_peered":"2024-05-08T10:24:29.215128+0000","last_unstale":"2024-05-08T10:24:30.875779+0000","last_undegraded":"2024-05-08T10:24:30.875779+0000","last_fullsized":"2024-05-08T10:24:30.875779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:20.796051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876282+0000","last_change":"2024-05-08T10:24:28.203626+0000","last_active":"2024-05-08T10:24:30.876282+0000","last_peered":"2024-05-08T10:24:30.876282+0000","last_clean":"2024-05-08T10:24:30.876282+0000","last_became_active":"2024-05-08T10:24:28.203350+0000","last_became_peered":"2024-05-08T10:24:28.203350+0000","last_unstale":"2024-05-08T10:24:30.876282+0000","last_undegraded":"2024-05-08T10:24:30.876282+0000","last_fullsized":"2024-05-08T10:24:30.876282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:41.340835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.676101+0000","last_change":"2024-05-08T10:24:29.204955+0000","last_active":"2024-05-08T10:24:30.676101+0000","last_peered":"2024-05-08T10:24:30.676101+0000","last_clean":"2024-05-08T10:24:30.676101+0000","last_became_active":"2024-05-08T10:24:29.204690+0000","last_became_peered":"2024-05-08T10:24:29.204690+0000","last_unstale":"2024-05-08T10:24:30.676101+0000","last_undegraded":"2024-05-08T10:24:30.676101+0000","last_fullsized":"2024-05-08T10:24:30.676101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:34:08.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876219+0000","last_change":"2024-05-08T10:24:28.206460+0000","last_active":"2024-05-08T10:24:30.876219+0000","last_peered":"2024-05-08T10:24:30.876219+0000","last_clean":"2024-05-08T10:24:30.876219+0000","last_became_active":"2024-05-08T10:24:28.205840+0000","last_became_peered":"2024-05-08T10:24:28.205840+0000","last_unstale":"2024-05-08T10:24:30.876219+0000","last_undegraded":"2024-05-08T10:24:30.876219+0000","last_fullsized":"2024-05-08T10:24:30.876219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:26:39.623897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.875914+0000","last_change":"2024-05-08T10:24:29.210385+0000","last_active":"2024-05-08T10:24:30.875914+0000","last_peered":"2024-05-08T10:24:30.875914+0000","last_clean":"2024-05-08T10:24:30.875914+0000","last_became_active":"2024-05-08T10:24:29.210099+0000","last_became_peered":"2024-05-08T10:24:29.210099+0000","last_unstale":"2024-05-08T10:24:30.875914+0000","last_undegraded":"2024-05-08T10:24:30.875914+0000","last_fullsized":"2024-05-08T10:24:30.875914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:20.706863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.876086+0000","last_change":"2024-05-08T10:24:28.207655+0000","last_active":"2024-05-08T10:24:30.876086+0000","last_peered":"2024-05-08T10:24:30.876086+0000","last_clean":"2024-05-08T10:24:30.876086+0000","last_became_active":"2024-05-08T10:24:28.206386+0000","last_became_peered":"2024-05-08T10:24:28.206386+0000","last_unstale":"2024-05-08T10:24:30.876086+0000","last_undegraded":"2024-05-08T10:24:30.876086+0000","last_fullsized":"2024-05-08T10:24:30.876086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:52.545489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.201702+0000","last_change":"2024-05-08T10:24:29.217425+0000","last_active":"2024-05-08T10:24:30.201702+0000","last_peered":"2024-05-08T10:24:30.201702+0000","last_clean":"2024-05-08T10:24:30.201702+0000","last_became_active":"2024-05-08T10:24:29.217173+0000","last_became_peered":"2024-05-08T10:24:29.217173+0000","last_unstale":"2024-05-08T10:24:30.201702+0000","last_undegraded":"2024-05-08T10:24:30.201702+0000","last_fullsized":"2024-05-08T10:24:30.201702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:59.898248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202463+0000","last_change":"2024-05-08T10:24:28.207560+0000","last_active":"2024-05-08T10:24:30.202463+0000","last_peered":"2024-05-08T10:24:30.202463+0000","last_clean":"2024-05-08T10:24:30.202463+0000","last_became_active":"2024-05-08T10:24:28.206663+0000","last_became_peered":"2024-05-08T10:24:28.206663+0000","last_unstale":"2024-05-08T10:24:30.202463+0000","last_undegraded":"2024-05-08T10:24:30.202463+0000","last_fullsized":"2024-05-08T10:24:30.202463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:07:20.206593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.202219+0000","last_change":"2024-05-08T10:24:29.200421+0000","last_active":"2024-05-08T10:24:30.202219+0000","last_peered":"2024-05-08T10:24:30.202219+0000","last_clean":"2024-05-08T10:24:30.202219+0000","last_became_active":"2024-05-08T10:24:29.199171+0000","last_became_peered":"2024-05-08T10:24:29.199171+0000","last_unstale":"2024-05-08T10:24:30.202219+0000","last_undegraded":"2024-05-08T10:24:30.202219+0000","last_fullsized":"2024-05-08T10:24:30.202219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:34:08.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.201755+0000","last_change":"2024-05-08T10:24:28.210349+0000","last_active":"2024-05-08T10:24:30.201755+0000","last_peered":"2024-05-08T10:24:30.201755+0000","last_clean":"2024-05-08T10:24:30.201755+0000","last_became_active":"2024-05-08T10:24:28.210067+0000","last_became_peered":"2024-05-08T10:24:28.210067+0000","last_unstale":"2024-05-08T10:24:30.201755+0000","last_undegraded":"2024-05-08T10:24:30.201755+0000","last_fullsized":"2024-05-08T10:24:30.201755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:19.702310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375334+0000","last_change":"2024-05-08T10:24:29.211269+0000","last_active":"2024-05-08T10:24:30.375334+0000","last_peered":"2024-05-08T10:24:30.375334+0000","last_clean":"2024-05-08T10:24:30.375334+0000","last_became_active":"2024-05-08T10:24:29.211002+0000","last_became_peered":"2024-05-08T10:24:29.211002+0000","last_unstale":"2024-05-08T10:24:30.375334+0000","last_undegraded":"2024-05-08T10:24:30.375334+0000","last_fullsized":"2024-05-08T10:24:30.375334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:28.183352+0000","last_clean_scrub_stamp":"2024-05-08T10:24:28.183352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:46.041093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.676021+0000","last_change":"2024-05-08T10:24:28.211525+0000","last_active":"2024-05-08T10:24:30.676021+0000","last_peered":"2024-05-08T10:24:30.676021+0000","last_clean":"2024-05-08T10:24:30.676021+0000","last_became_active":"2024-05-08T10:24:28.211152+0000","last_became_peered":"2024-05-08T10:24:28.211152+0000","last_unstale":"2024-05-08T10:24:30.676021+0000","last_undegraded":"2024-05-08T10:24:30.676021+0000","last_fullsized":"2024-05-08T10:24:30.676021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:24:27.178799+0000","last_clean_scrub_stamp":"2024-05-08T10:24:27.178799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:07:20.206593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:24:30.375406+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:24:30.375406+0000","last_peered":"2024-05-08T10:24:30.375406+0000","last_clean":"2024-05-08T10:24:30.375406+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:30.375406+0000","last_undegraded":"2024-05-08T10:24:30.375406+0000","last_fullsized":"2024-05-08T10:24:30.375406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:36.928 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T10:24:36.929 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-08T10:24:37.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.087+0000 7f5257e64640 1 Processor -- start 2024-05-08T10:24:37.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.087+0000 7f5257e64640 1 -- start start 2024-05-08T10:24:37.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5257e64640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f52500b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5257e64640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52500d1270 0x7f52500d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5257e64640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f525015d580 con 0x7f52501603f0 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5257e64640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f52500b4e70 con 0x7f52500d1270 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5257e64640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f52500b5150 con 0x7f52501607d0 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5256401640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52500d1270 0x7f52500d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f52553ff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f52500b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5255c00640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f52501603f0 0x7f525015ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:55042/0 (socket says 172.21.15.143:55042) 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5256401640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52500d1270 0x7f52500d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55682/0 (socket says 172.21.15.143:55682) 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f52553ff640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f52500b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:40210/0 (socket says 172.21.15.143:40210) 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5255c00640 1 -- 172.21.15.143:0/411590671 learned_addr learned my addr 172.21.15.143:0/411590671 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5256401640 1 -- 172.21.15.143:0/411590671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 msgr2=0x7f52500b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5256401640 1 --2- 172.21.15.143:0/411590671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f52500b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5256401640 1 -- 172.21.15.143:0/411590671 >> v1:172.21.15.163:6789/0 conn(0x7f52501603f0 legacy=0x7f525015ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.088+0000 7f5256401640 1 -- 172.21.15.143:0/411590671 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52500b5430 con 0x7f52500d1270 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.089+0000 7f5256401640 1 --2- 172.21.15.143:0/411590671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52500d1270 0x7f52500d1700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5248009d90 tx=0x7f524802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a0a5522b0b23b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.089+0000 7f5254bfe640 1 -- 172.21.15.143:0/411590671 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248007740 con 0x7f52500d1270 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.089+0000 7f5254bfe640 1 -- 172.21.15.143:0/411590671 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52480078e0 con 0x7f52500d1270 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.089+0000 7f5254bfe640 1 -- 172.21.15.143:0/411590671 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248007cb0 con 0x7f52500d1270 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.090+0000 7f5257e64640 1 -- 172.21.15.143:0/411590671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52500d1270 msgr2=0x7f52500d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.090+0000 7f5257e64640 1 --2- 172.21.15.143:0/411590671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52500d1270 0x7f52500d1700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5248009d90 tx=0x7f524802a660 comp rx=0 tx=0).stop 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.090+0000 7f5257e64640 1 -- 172.21.15.143:0/411590671 shutdown_connections 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.090+0000 7f5257e64640 1 --2- 172.21.15.143:0/411590671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52500d1270 0x7f52500d1700 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.090+0000 7f5257e64640 1 --2- 172.21.15.143:0/411590671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f52500b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.090+0000 7f5257e64640 1 -- 172.21.15.143:0/411590671 >> 172.21.15.143:0/411590671 conn(0x7f525006c500 msgr2=0x7f525006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.090+0000 7f5257e64640 1 -- 172.21.15.143:0/411590671 shutdown_connections 2024-05-08T10:24:37.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.090+0000 7f5257e64640 1 -- 172.21.15.143:0/411590671 wait complete. 2024-05-08T10:24:37.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.091+0000 7f5257e64640 1 Processor -- start 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.091+0000 7f5257e64640 1 -- start start 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5257e64640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52500d1270 0x7f525009a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5257e64640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52501603f0 0x7f525015f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5257e64640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f525015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5257e64640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5250072840 con 0x7f52501603f0 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5257e64640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f52500b59f0 con 0x7f52500d1270 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5257e64640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f52500729c0 con 0x7f52501607d0 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52553ff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52501603f0 0x7f525015f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52553ff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52501603f0 0x7f525015f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55684/0 (socket says 172.21.15.143:55684) 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52553ff640 1 -- 172.21.15.143:0/589591012 learned_addr learned my addr 172.21.15.143:0/589591012 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5256401640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f525015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5255c00640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52500d1270 0x7f525009a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52553ff640 1 -- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 msgr2=0x7f525015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52553ff640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f525015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52553ff640 1 -- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52500d1270 msgr2=0x7f525009a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52553ff640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52500d1270 0x7f525009a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52553ff640 1 -- 172.21.15.143:0/589591012 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525015fd60 con 0x7f52501603f0 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5255c00640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52500d1270 0x7f525009a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f5256401640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f525015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52553ff640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52501603f0 0x7f525015f820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f524000e8a0 tx=0x7f524000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.092+0000 7f52467fc640 1 -- 172.21.15.143:0/589591012 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240017070 con 0x7f52501603f0 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.093+0000 7f52467fc640 1 -- 172.21.15.143:0/589591012 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524000c940 con 0x7f52501603f0 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.093+0000 7f52467fc640 1 -- 172.21.15.143:0/589591012 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524000cd30 con 0x7f52501603f0 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.093+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525006feb0 con 0x7f52501603f0 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.093+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525015e2f0 con 0x7f52501603f0 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.094+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525006a550 con 0x7f52501603f0 2024-05-08T10:24:37.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.094+0000 7f52467fc640 1 -- 172.21.15.143:0/589591012 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f524001a070 con 0x7f52501603f0 2024-05-08T10:24:37.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.095+0000 7f52467fc640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5234076300 0x7f52340787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.095+0000 7f5255c00640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5234076300 0x7f52340787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.095+0000 7f52467fc640 1 -- 172.21.15.143:0/589591012 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f5240097480 con 0x7f52501603f0 2024-05-08T10:24:37.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.095+0000 7f5255c00640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5234076300 0x7f52340787c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f524c000f60 tx=0x7f524c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:37.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.099+0000 7f52467fc640 1 -- 172.21.15.143:0/589591012 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5240060df0 con 0x7f52501603f0 2024-05-08T10:24:37.340 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.355+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f52500b4bb0 con 0x7f52501603f0 2024-05-08T10:24:37.342 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.358+0000 7f52467fc640 1 -- 172.21.15.143:0/589591012 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f52400606f0 con 0x7f52501603f0 2024-05-08T10:24:37.343 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2024-05-08T10:24:37.343 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQCCUjtm9n3YOhAAq9VPDZFRf917El5YIeO+8A== 2024-05-08T10:24:37.343 INFO:teuthology.orchestra.run.smithi143.stdout: caps mds = "allow" 2024-05-08T10:24:37.343 INFO:teuthology.orchestra.run.smithi143.stdout: caps mon = "allow r" 2024-05-08T10:24:37.343 INFO:teuthology.orchestra.run.smithi143.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-08T10:24:37.343 INFO:teuthology.orchestra.run.smithi143.stderr:updated caps for client.0 2024-05-08T10:24:37.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5234076300 msgr2=0x7f52340787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5234076300 0x7f52340787c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f524c000f60 tx=0x7f524c009040 comp rx=0 tx=0).stop 2024-05-08T10:24:37.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52501603f0 msgr2=0x7f525015f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52501603f0 0x7f525015f820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f524000e8a0 tx=0x7f524000ed60 comp rx=0 tx=0).stop 2024-05-08T10:24:37.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 shutdown_connections 2024-05-08T10:24:37.345 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f52501607d0 0x7f525015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5234076300 0x7f52340787c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52501603f0 0x7f525015f820 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 --2- 172.21.15.143:0/589591012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52500d1270 0x7f525009a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 >> 172.21.15.143:0/589591012 conn(0x7f525006c500 msgr2=0x7f5250072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:37.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 shutdown_connections 2024-05-08T10:24:37.346 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.360+0000 7f5257e64640 1 -- 172.21.15.143:0/589591012 wait complete. 2024-05-08T10:24:37.356 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:37.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.471+0000 7fc3dcc54640 1 Processor -- start 2024-05-08T10:24:37.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.471+0000 7fc3dcc54640 1 -- start start 2024-05-08T10:24:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.472+0000 7fc3dcc54640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc3d815f760 0x7fc3d80b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.472+0000 7fc3dcc54640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc3d80cfc10 0x7fc3d80d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.472+0000 7fc3dcc54640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d80d0070 con 0x7fc3d80d0830 2024-05-08T10:24:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.472+0000 7fc3dcc54640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d815fb40 con 0x7fc3d815f760 2024-05-08T10:24:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.472+0000 7fc3dcc54640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d80d36f0 con 0x7fc3d80cfc10 2024-05-08T10:24:37.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.473+0000 7fc3d659c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc3d815f760 0x7fc3d80b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.473+0000 7fc3d659c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc3d815f760 0x7fc3d80b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55692/0 (socket says 172.21.15.143:55692) 2024-05-08T10:24:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.473+0000 7fc3d659c640 1 -- 172.21.15.143:0/3008313911 learned_addr learned my addr 172.21.15.143:0/3008313911 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.473+0000 7fc3d5d9b640 1 --2- 172.21.15.143:0/3008313911 >> v2:172.21.15.163:3300/0 conn(0x7fc3d80cfc10 0x7fc3d80d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.473+0000 7fc3d659c640 1 -- 172.21.15.143:0/3008313911 >> v2:172.21.15.163:3300/0 conn(0x7fc3d80cfc10 msgr2=0x7fc3d80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.473+0000 7fc3d659c640 1 --2- 172.21.15.143:0/3008313911 >> v2:172.21.15.163:3300/0 conn(0x7fc3d80cfc10 0x7fc3d80d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.473+0000 7fc3d659c640 1 -- 172.21.15.143:0/3008313911 >> v1:172.21.15.163:6789/0 conn(0x7fc3d80d0830 legacy=0x7fc3d80b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.473+0000 7fc3d659c640 1 -- 172.21.15.143:0/3008313911 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d80d39d0 con 0x7fc3d815f760 2024-05-08T10:24:37.460 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3d659c640 1 --2- 172.21.15.143:0/3008313911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 0x7fc3d80b4770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80b7e20 tx=0x7fc3c802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cb470b86212bb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3d559a640 1 -- 172.21.15.143:0/3008313911 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8036070 con 0x7fc3d815f760 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3d559a640 1 -- 172.21.15.143:0/3008313911 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c8031600 con 0x7fc3d815f760 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3d559a640 1 -- 172.21.15.143:0/3008313911 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80319d0 con 0x7fc3d815f760 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3dcc54640 1 -- 172.21.15.143:0/3008313911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 msgr2=0x7fc3d80b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3dcc54640 1 --2- 172.21.15.143:0/3008313911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 0x7fc3d80b4770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80b7e20 tx=0x7fc3c802a6a0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3dcc54640 1 -- 172.21.15.143:0/3008313911 shutdown_connections 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3dcc54640 1 --2- 172.21.15.143:0/3008313911 >> v2:172.21.15.163:3300/0 conn(0x7fc3d80cfc10 0x7fc3d80d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3dcc54640 1 --2- 172.21.15.143:0/3008313911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 0x7fc3d80b4770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3dcc54640 1 -- 172.21.15.143:0/3008313911 >> 172.21.15.143:0/3008313911 conn(0x7fc3d80740e0 msgr2=0x7fc3d806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3dcc54640 1 -- 172.21.15.143:0/3008313911 shutdown_connections 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.474+0000 7fc3dcc54640 1 -- 172.21.15.143:0/3008313911 wait complete. 2024-05-08T10:24:37.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.476+0000 7fc3dcc54640 1 Processor -- start 2024-05-08T10:24:37.462 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.476+0000 7fc3dcc54640 1 -- start start 2024-05-08T10:24:37.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.476+0000 7fc3dcc54640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3d80cfc10 0x7fc3d81e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.476+0000 7fc3dcc54640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3d80d0830 0x7fc3d81ea180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.476+0000 7fc3dcc54640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 0x7fc3d80b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.476+0000 7fc3dcc54640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d80d4270 con 0x7fc3d815f760 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.476+0000 7fc3dcc54640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d80d3f90 con 0x7fc3d80d0830 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.476+0000 7fc3dcc54640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d80b9720 con 0x7fc3d80cfc10 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d6d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 0x7fc3d80b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d6d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 0x7fc3d80b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55702/0 (socket says 172.21.15.143:55702) 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d6d9d640 1 -- 172.21.15.143:0/1017359362 learned_addr learned my addr 172.21.15.143:0/1017359362 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d5d9b640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3d80d0830 0x7fc3d81ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d659c640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3d80cfc10 0x7fc3d81e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d6d9d640 1 -- 172.21.15.143:0/1017359362 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3d80cfc10 msgr2=0x7fc3d81e74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d6d9d640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3d80cfc10 0x7fc3d81e74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d6d9d640 1 -- 172.21.15.143:0/1017359362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3d80d0830 msgr2=0x7fc3d81ea180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d6d9d640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3d80d0830 0x7fc3d81ea180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d6d9d640 1 -- 172.21.15.143:0/1017359362 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d814b970 con 0x7fc3d815f760 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3d6d9d640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 0x7fc3d80b3260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c3f0 tx=0x7fc3d000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:37.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3ceffd640 1 -- 172.21.15.143:0/1017359362 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0017070 con 0x7fc3d815f760 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3ceffd640 1 -- 172.21.15.143:0/1017359362 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d00052d0 con 0x7fc3d815f760 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d814bc50 con 0x7fc3d815f760 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3ceffd640 1 -- 172.21.15.143:0/1017359362 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0003810 con 0x7fc3d815f760 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.477+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d814c210 con 0x7fc3d815f760 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.478+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d806a550 con 0x7fc3d815f760 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.479+0000 7fc3ceffd640 1 -- 172.21.15.143:0/1017359362 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc3d001a070 con 0x7fc3d815f760 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.479+0000 7fc3ceffd640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc3b80762d0 0x7fc3b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.479+0000 7fc3d659c640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc3b80762d0 0x7fc3b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.479+0000 7fc3ceffd640 1 -- 172.21.15.143:0/1017359362 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc3d00969f0 con 0x7fc3d815f760 2024-05-08T10:24:37.466 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.480+0000 7fc3d659c640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc3b80762d0 0x7fc3b8078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8033000 tx=0x7fc3c8009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:37.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.483+0000 7fc3ceffd640 1 -- 172.21.15.143:0/1017359362 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc3d80d0070 con 0x7fc3d815f760 2024-05-08T10:24:37.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.700+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3d80ce680 con 0x7fc3d815f760 2024-05-08T10:24:37.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.701+0000 7fc3ceffd640 1 -- 172.21.15.143:0/1017359362 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5190 (secure 0 0 0) 0x7fc3d00602c0 con 0x7fc3d815f760 2024-05-08T10:24:37.687 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:37.687 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2519238209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2519238209},{"type":"v1","addr":"172.21.15.163:6834","nonce":2519238209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/420423244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":420423244},{"type":"v1","addr":"172.21.15.163:6835","nonce":420423244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4794,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2143046617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2143046617},{"type":"v1","addr":"172.21.15.143:6836","nonce":2143046617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:24:28.550393+0000","modified":"2024-05-08T10:24:30.548210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4797},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4797":{"gid":4797,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3656674830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3656674830},{"type":"v1","addr":"172.21.15.143:6837","nonce":3656674830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4797,"qdb_cluster":[4797]},"id":2}]} 2024-05-08T10:24:37.687 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 13 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc3b80762d0 msgr2=0x7fc3b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc3b80762d0 0x7fc3b8078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8033000 tx=0x7fc3c8009000 comp rx=0 tx=0).stop 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 msgr2=0x7fc3d80b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 0x7fc3d80b3260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000c3f0 tx=0x7fc3d000c8b0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 shutdown_connections 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc3b80762d0 0x7fc3b8078790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3d815f760 0x7fc3d80b3260 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3d80d0830 0x7fc3d81ea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 --2- 172.21.15.143:0/1017359362 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc3d80cfc10 0x7fc3d81e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 >> 172.21.15.143:0/1017359362 conn(0x7fc3d80740e0 msgr2=0x7fc3d80ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:37.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 shutdown_connections 2024-05-08T10:24:37.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:37.703+0000 7fc3dcc54640 1 -- 172.21.15.143:0/1017359362 wait complete. 2024-05-08T10:24:38.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T10:24:28.550393+0000', 'modified': '2024-05-08T10:24:30.548210+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4797}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4797': {'gid': 4797, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6837/3656674830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6835', 'nonce': 3656674830}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 3656674830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4797, 'qdb_cluster': [4797]} 2024-05-08T10:24:38.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T10:24:38.106 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-08T10:24:38.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.225+0000 7f2cf3654640 1 Processor -- start 2024-05-08T10:24:38.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.225+0000 7f2cf3654640 1 -- start start 2024-05-08T10:24:38.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf3654640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf3654640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2cec0b44a0 0x7f2cec06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf3654640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec15da70 con 0x7f2cec15ac30 2024-05-08T10:24:38.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf3654640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2cec0af690 con 0x7f2cec0b44a0 2024-05-08T10:24:38.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf3654640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec15dd50 con 0x7f2cec0b17c0 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf1bf1640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2cec0b44a0 0x7f2cec06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec0b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.143:40222/0 (socket says 172.21.15.143:40222) 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf0bef640 1 -- 172.21.15.143:0/2346761694 learned_addr learned my addr 172.21.15.143:0/2346761694 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.226+0000 7f2cf13f0640 1 --1- 172.21.15.143:0/2346761694 >> v1:172.21.15.163:6789/0 conn(0x7f2cec15ac30 0x7f2cec0aef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:55054/0 (socket says 172.21.15.143:55054) 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.227+0000 7f2cf0bef640 1 -- 172.21.15.143:0/2346761694 >> v2:172.21.15.163:3300/0 conn(0x7f2cec0b44a0 msgr2=0x7f2cec06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.227+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/2346761694 >> v2:172.21.15.163:3300/0 conn(0x7f2cec0b44a0 0x7f2cec06f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.227+0000 7f2cf0bef640 1 -- 172.21.15.143:0/2346761694 >> v1:172.21.15.163:6789/0 conn(0x7f2cec15ac30 legacy=0x7f2cec0aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.227+0000 7f2cf0bef640 1 -- 172.21.15.143:0/2346761694 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec15e030 con 0x7f2cec0b17c0 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.227+0000 7f2ce3fff640 1 -- 172.21.15.143:0/2346761694 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921998119 0 0) 0x7f2cec15da70 con 0x7f2cec15ac30 2024-05-08T10:24:38.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.227+0000 7f2cf1bf1640 1 --2- 172.21.15.143:0/2346761694 >> v2:172.21.15.163:3300/0 conn(0x7f2cec0b44a0 0x7f2cec06f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.227+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/2346761694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec0b3f60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009870 tx=0x7f2cdc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aba1e1fc737245bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.227+0000 7f2ce3fff640 1 -- 172.21.15.143:0/2346761694 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc037070 con 0x7f2cec0b17c0 2024-05-08T10:24:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2ce3fff640 1 -- 172.21.15.143:0/2346761694 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cdc032440 con 0x7f2cec0b17c0 2024-05-08T10:24:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2ce3fff640 1 -- 172.21.15.143:0/2346761694 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc032810 con 0x7f2cec0b17c0 2024-05-08T10:24:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2cf3654640 1 -- 172.21.15.143:0/2346761694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 msgr2=0x7f2cec0b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2cf3654640 1 --2- 172.21.15.143:0/2346761694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec0b3f60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009870 tx=0x7f2cdc02a1c0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2cf3654640 1 -- 172.21.15.143:0/2346761694 shutdown_connections 2024-05-08T10:24:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2cf3654640 1 --2- 172.21.15.143:0/2346761694 >> v2:172.21.15.163:3300/0 conn(0x7f2cec0b44a0 0x7f2cec06f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.214 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2cf3654640 1 --2- 172.21.15.143:0/2346761694 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec0b3f60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2cf3654640 1 -- 172.21.15.143:0/2346761694 >> 172.21.15.143:0/2346761694 conn(0x7f2cec06d610 msgr2=0x7f2cec06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:38.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2cf3654640 1 -- 172.21.15.143:0/2346761694 shutdown_connections 2024-05-08T10:24:38.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.228+0000 7f2cf3654640 1 -- 172.21.15.143:0/2346761694 wait complete. 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.229+0000 7f2cf3654640 1 Processor -- start 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.229+0000 7f2cf3654640 1 -- start start 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf3654640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec1f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf3654640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cec0b44a0 0x7f2cec0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf3654640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cec15ac30 0x7f2cec1e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf3654640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec15b190 con 0x7f2cec0b44a0 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf3654640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec15b010 con 0x7f2cec15ac30 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf3654640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec06fa10 con 0x7f2cec0b17c0 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cec0b44a0 0x7f2cec0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cec0b44a0 0x7f2cec0b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55716/0 (socket says 172.21.15.143:55716) 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3383901972 learned_addr learned my addr 172.21.15.143:0/3383901972 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf1bf1640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cec15ac30 0x7f2cec1e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.230+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec1f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3383901972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 msgr2=0x7f2cec1f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec1f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3383901972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cec15ac30 msgr2=0x7f2cec1e6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cec15ac30 0x7f2cec1e6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3383901972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec0b55e0 con 0x7f2cec0b44a0 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cec0b44a0 0x7f2cec0b50a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc035040 tx=0x7f2cdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2ce1ffb640 1 -- 172.21.15.143:0/3383901972 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc037040 con 0x7f2cec0b44a0 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2ce1ffb640 1 -- 172.21.15.143:0/3383901972 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cdc004230 con 0x7f2cec0b44a0 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2cf3654640 1 -- 172.21.15.143:0/3383901972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec1e6c80 con 0x7f2cec0b44a0 2024-05-08T10:24:38.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2ce1ffb640 1 -- 172.21.15.143:0/3383901972 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc003610 con 0x7f2cec0b44a0 2024-05-08T10:24:38.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.231+0000 7f2cf3654640 1 -- 172.21.15.143:0/3383901972 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec1e7240 con 0x7f2cec0b44a0 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.233+0000 7f2ce1ffb640 1 -- 172.21.15.143:0/3383901972 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2cdc02ad10 con 0x7f2cec0b44a0 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.233+0000 7f2ce1ffb640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cd00762d0 0x7f2cd0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.233+0000 7f2ce1ffb640 1 -- 172.21.15.143:0/3383901972 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2cdc0b8010 con 0x7f2cec0b44a0 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.233+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cd00762d0 0x7f2cd0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.234+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cd00762d0 0x7f2cd0078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8000f60 tx=0x7f2ce8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.234+0000 7f2cf636c740 1 Processor -- start 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.234+0000 7f2cf636c740 1 -- start start 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 0x5617f37eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f37ebca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37bbbb0 0x5617f37bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf636c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5617f37258d0 con 0x5617f37e9330 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf636c740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5617f36dec10 con 0x5617f37e8f50 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf636c740 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x5617f3721890 con 0x5617f37bbbb0 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f37ebca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f37ebca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55728/0 (socket says 172.21.15.143:55728) 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf0bef640 1 -- 172.21.15.143:0/2168544338 learned_addr learned my addr 172.21.15.143:0/2168544338 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf1bf1640 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37bbbb0 0x5617f37bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 0x5617f37eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf0bef640 1 -- 172.21.15.143:0/2168544338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37bbbb0 msgr2=0x5617f37bf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37bbbb0 0x5617f37bf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf0bef640 1 -- 172.21.15.143:0/2168544338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 msgr2=0x5617f37eb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 0x5617f37eb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf0bef640 1 -- 172.21.15.143:0/2168544338 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617f36e65d0 con 0x5617f37e9330 2024-05-08T10:24:38.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf1bf1640 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37bbbb0 0x5617f37bf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f37ebca0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc032fd0 tx=0x7f2cdc03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec962c6f3c7a32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.235+0000 7f2cd6ffd640 1 -- 172.21.15.143:0/2168544338 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc081270 con 0x5617f37e9330 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cd6ffd640 1 -- 172.21.15.143:0/2168544338 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cdc085620 con 0x5617f37e9330 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cd6ffd640 1 -- 172.21.15.143:0/2168544338 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0816d0 con 0x5617f37e9330 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cf636c740 1 -- 172.21.15.143:0/2168544338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 msgr2=0x5617f37ebca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cf636c740 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f37ebca0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc032fd0 tx=0x7f2cdc03b000 comp rx=0 tx=0).stop 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cf636c740 1 -- 172.21.15.143:0/2168544338 shutdown_connections 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cf636c740 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37bbbb0 0x5617f37bf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cf636c740 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f37ebca0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cf636c740 1 --2- 172.21.15.143:0/2168544338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 0x5617f37eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cf636c740 1 -- 172.21.15.143:0/2168544338 >> 172.21.15.143:0/2168544338 conn(0x5617f37bde20 msgr2=0x5617f3806760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cf636c740 1 -- 172.21.15.143:0/2168544338 shutdown_connections 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.236+0000 7f2cf636c740 1 -- 172.21.15.143:0/2168544338 wait complete. 2024-05-08T10:24:38.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.237+0000 7f2cf636c740 1 -- start start 2024-05-08T10:24:38.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.237+0000 7f2cf636c740 1 Processor -- start 2024-05-08T10:24:38.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 0x5617f37e7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e9330 0x5617f37ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37ee5b0 0x5617f37ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf636c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5617f36dec10 con 0x5617f37ee5b0 2024-05-08T10:24:38.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf636c740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5617f36e2760 con 0x5617f37e8f50 2024-05-08T10:24:38.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf636c740 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x5617f37258d0 con 0x5617f37e9330 2024-05-08T10:24:38.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf636c740 10 client.0 _ll_register_callbacks cb 0x5617f371bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T10:24:38.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf1bf1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37ee5b0 0x5617f37ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.229 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf1bf1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37ee5b0 0x5617f37ec8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55736/0 (socket says 172.21.15.143:55736) 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf1bf1640 1 -- 172.21.15.143:0/3597192100 learned_addr learned my addr 172.21.15.143:0/3597192100 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 0x5617f37e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e9330 0x5617f37ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf1bf1640 1 -- 172.21.15.143:0/3597192100 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e9330 msgr2=0x5617f37ec3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf1bf1640 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e9330 0x5617f37ec3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf1bf1640 1 -- 172.21.15.143:0/3597192100 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 msgr2=0x5617f37e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf1bf1640 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 0x5617f37e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf1bf1640 1 -- 172.21.15.143:0/3597192100 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617f34372d0 con 0x5617f37ee5b0 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf1bf1640 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37ee5b0 0x5617f37ec8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4004350 tx=0x7f2ce4004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124d94a1fd7c3141 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2ccbfff640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3597192100 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4019020 con 0x5617f37ee5b0 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3597192100 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2ce4007a40 con 0x5617f37ee5b0 2024-05-08T10:24:38.230 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.238+0000 7f2cf636c740 1 -- 172.21.15.143:0/3597192100 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cdc085620 con 0x5617f37ee5b0 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3597192100 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f2ce4023050 con 0x5617f37ee5b0 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf636c740 10 client.4983 fetch_fsmap learned FSMap version 13 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf636c740 1 -- 172.21.15.143:0/3597192100 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5617f35016b0 con 0x5617f37ee5b0 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3597192100 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cdc085620 con 0x5617f37ee5b0 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3597192100 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7f2ce4026020 con 0x5617f37ee5b0 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf636c740 10 client.4983 fetch_fsmap finished waiting for FSMap version 13 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf636c740 10 client.4983 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf636c740 20 client.4983 populate_metadata read hostname 'smithi143' 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] conn(0x5617f3809560 0x5617f3809940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf636c740 4 client.4983 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf636c740 1 -- 172.21.15.143:0/3597192100 --> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617f36a9760 con 0x5617f3809560 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] conn(0x5617f3809560 0x5617f3809940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2ccbfff640 10 client.4983 ms_handle_connect on v2:172.21.15.143:6835/3656674830 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.239+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] conn(0x5617f3809560 0x5617f3809940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55788c2364900b08 server_cookie=781a645a38fd151a in_seq=0 out_seq=0 2024-05-08T10:24:38.231 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3597192100 <== mds.0 v2:172.21.15.143:6835/3656674830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5617f36a9760 con 0x5617f3809560 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2ccbfff640 10 client.4983 handle_command_reply: tid=0 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 client.4983 shutdown 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 -- 172.21.15.143:0/3597192100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37ee5b0 msgr2=0x5617f37ec8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37ee5b0 0x5617f37ec8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4004350 tx=0x7f2ce4004810 comp rx=0 tx=0).stop 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 -- 172.21.15.143:0/3597192100 shutdown_connections 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] conn(0x5617f3809560 0x5617f3809940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37ee5b0 0x5617f37ec8f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e9330 0x5617f37ec3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3597192100 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37e8f50 0x5617f37e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 -- 172.21.15.143:0/3597192100 >> 172.21.15.143:0/3597192100 conn(0x5617f37bbbb0 msgr2=0x5617f37c11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2ccbfff640 0 client.4983 ms_handle_reset on v2:172.21.15.143:6835/3656674830 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 -- 172.21.15.143:0/3597192100 shutdown_connections 2024-05-08T10:24:38.232 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 1 -- 172.21.15.143:0/3597192100 wait complete. 2024-05-08T10:24:38.233 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.240+0000 7f2cf636c740 20 client.4983 trim_cache size 0 max 16384 2024-05-08T10:24:38.244 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.259+0000 7f2cf636c740 1 Processor -- start 2024-05-08T10:24:38.244 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.259+0000 7f2cf636c740 1 -- start start 2024-05-08T10:24:38.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e8f50 0x5617f37eec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.246 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3805f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 0x5617f37ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf636c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec2017d0 con 0x5617f37e9330 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf636c740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec2007f0 con 0x5617f37ee5b0 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf636c740 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec0d1d60 con 0x5617f37e8f50 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3805f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3805f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55748/0 (socket says 172.21.15.143:55748) 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3116239760 learned_addr learned my addr 172.21.15.143:0/3116239760 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3116239760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e8f50 msgr2=0x5617f37eec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3116239760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e8f50 0x5617f37eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3116239760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 msgr2=0x5617f37ec270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3116239760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 0x5617f37ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3116239760 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617f37bdbc0 con 0x5617f37e9330 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3116239760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3805f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc032fd0 tx=0x7f2cdc0b6410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f26076c76f9353 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.247 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cd67fc640 1 -- 172.21.15.143:0/3116239760 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc07d8c0 con 0x5617f37e9330 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cd67fc640 1 -- 172.21.15.143:0/3116239760 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cdc085620 con 0x5617f37e9330 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.260+0000 7f2cd67fc640 1 -- 172.21.15.143:0/3116239760 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0816f0 con 0x5617f37e9330 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 -- 172.21.15.143:0/3116239760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 msgr2=0x5617f3805f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3116239760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3805f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc032fd0 tx=0x7f2cdc0b6410 comp rx=0 tx=0).stop 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 -- 172.21.15.143:0/3116239760 shutdown_connections 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3116239760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 0x5617f37ec270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3116239760 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3805f80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3116239760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e8f50 0x5617f37eec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 -- 172.21.15.143:0/3116239760 >> 172.21.15.143:0/3116239760 conn(0x5617f37bbbb0 msgr2=0x5617f38003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 -- 172.21.15.143:0/3116239760 shutdown_connections 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 -- 172.21.15.143:0/3116239760 wait complete. 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 -- start start 2024-05-08T10:24:38.248 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.261+0000 7f2cf636c740 1 Processor -- start 2024-05-08T10:24:38.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e8f50 0x5617f3804d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3883780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.252 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf636c740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 0x5617f37c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf636c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5617f37e8470 con 0x5617f37e9330 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf636c740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec2001a0 con 0x5617f37ee5b0 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf636c740 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x5617f37ef670 con 0x5617f37e8f50 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf636c740 10 client.0 _ll_register_callbacks cb 0x7f2ce4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3883780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf0bef640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3883780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55752/0 (socket says 172.21.15.143:55752) 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3489568695 learned_addr learned my addr 172.21.15.143:0/3489568695 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.262+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e8f50 0x5617f3804d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf1bf1640 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 0x5617f37c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3489568695 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e8f50 msgr2=0x5617f3804d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e8f50 0x5617f3804d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3489568695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 msgr2=0x5617f37c0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 0x5617f37c0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.253 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf0bef640 1 -- 172.21.15.143:0/3489568695 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617f3883cc0 con 0x5617f37e9330 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf1bf1640 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 0x5617f37c0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf0bef640 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3883780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc07d2a0 tx=0x7f2cdc03ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2229ffd15e369a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2ccbfff640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3489568695 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc07d8c0 con 0x5617f37e9330 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3489568695 <== mon.0 v2:172.21.15.143:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2cdc0b6200 con 0x5617f37e9330 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf636c740 1 -- 172.21.15.143:0/3489568695 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cdc085620 con 0x5617f37e9330 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3489568695 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f2cdc08a040 con 0x5617f37e9330 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf636c740 10 client.4989 fetch_fsmap learned FSMap version 13 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf636c740 1 -- 172.21.15.143:0/3489568695 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5617f37edfa0 con 0x5617f37e9330 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3489568695 <== mon.0 v2:172.21.15.143:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cdc085620 con 0x5617f37e9330 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3489568695 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7f2cdc04e060 con 0x5617f37e9330 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf636c740 10 client.4989 fetch_fsmap finished waiting for FSMap version 13 2024-05-08T10:24:38.254 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf636c740 10 client.4989 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf636c740 20 client.4989 populate_metadata read hostname 'smithi143' 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] conn(0x5617f3806bb0 0x5617f3806f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf636c740 4 client.4989 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.263+0000 7f2cf636c740 1 -- 172.21.15.143:0/3489568695 --> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] -- command(tid 0: {"prefix": "status"}) -- 0x5617f37334e0 con 0x5617f3806bb0 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] conn(0x5617f3806bb0 0x5617f3806f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2ccbfff640 10 client.4989 ms_handle_connect on v2:172.21.15.143:6835/3656674830 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf13f0640 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] conn(0x5617f3806bb0 0x5617f3806f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=231d5eb0adf257d6 server_cookie=4308b203d39c8ade in_seq=0 out_seq=0 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2ccbfff640 1 -- 172.21.15.143:0/3489568695 <== mds.0 v2:172.21.15.143:6835/3656674830 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5617f37334e0 con 0x5617f3806bb0 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2ccbfff640 10 client.4989 handle_command_reply: tid=0 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 client.4989 shutdown 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 -- 172.21.15.143:0/3489568695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 msgr2=0x5617f3883780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3883780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc07d2a0 tx=0x7f2cdc03ffb0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 -- 172.21.15.143:0/3489568695 shutdown_connections 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.143:6835/3656674830,v1:172.21.15.143:6837/3656674830] conn(0x5617f3806bb0 0x5617f3806f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5617f37ee5b0 0x5617f37c0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5617f37e9330 0x5617f3883780 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2ccbfff640 0 client.4989 ms_handle_reset on v2:172.21.15.143:6835/3656674830 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 --2- 172.21.15.143:0/3489568695 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5617f37e8f50 0x5617f3804d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 -- 172.21.15.143:0/3489568695 >> 172.21.15.143:0/3489568695 conn(0x5617f37bbbb0 msgr2=0x5617f37ec270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 -- 172.21.15.143:0/3489568695 shutdown_connections 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 1 -- 172.21.15.143:0/3489568695 wait complete. 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.264+0000 7f2cf636c740 20 client.4989 trim_cache size 0 max 16384 2024-05-08T10:24:38.256 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "cluster_fsid": "aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64", 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "whoami": 0, 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 4797, 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "want_state": "up:active", 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "state": "up:active", 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs", 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "rank_uptime": 9.0660080910000005, 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "mdsmap_epoch": 13, 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch": 31, 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_epoch_barrier": 31, 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout: "uptime": 16.122011100000002 2024-05-08T10:24:38.257 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:38.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 -- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cd00762d0 msgr2=0x7f2cd0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cd00762d0 0x7f2cd0078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8000f60 tx=0x7f2ce8009040 comp rx=0 tx=0).stop 2024-05-08T10:24:38.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 -- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cec0b44a0 msgr2=0x7f2cec0b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cec0b44a0 0x7f2cec0b50a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc035040 tx=0x7f2cdc0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 -- 172.21.15.143:0/3383901972 shutdown_connections 2024-05-08T10:24:38.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2cec15ac30 0x7f2cec1e6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2cd00762d0 0x7f2cd0078790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2cec0b44a0 0x7f2cec0b50a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 --2- 172.21.15.143:0/3383901972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2cec0b17c0 0x7f2cec1f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 -- 172.21.15.143:0/3383901972 >> 172.21.15.143:0/3383901972 conn(0x7f2cec06d610 msgr2=0x7f2cec15b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:38.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 -- 172.21.15.143:0/3383901972 shutdown_connections 2024-05-08T10:24:38.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.265+0000 7f2cf3654640 1 -- 172.21.15.143:0/3383901972 wait complete. 2024-05-08T10:24:38.261 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:24:38.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.374+0000 7f142015f640 1 Processor -- start 2024-05-08T10:24:38.360 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.375+0000 7f142015f640 1 -- start start 2024-05-08T10:24:38.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.375+0000 7f142015f640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f14180d3640 0x7f14180d4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.375+0000 7f142015f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14180d0040 0x7f14180d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.375+0000 7f142015f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14180d3b20 con 0x7f141815f410 2024-05-08T10:24:38.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.375+0000 7f142015f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f14180d3e00 con 0x7f14180d0040 2024-05-08T10:24:38.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.375+0000 7f142015f640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f14180d40e0 con 0x7f14180d3640 2024-05-08T10:24:38.361 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.376+0000 7f141e6fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14180d0040 0x7f14180d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.376+0000 7f141e6fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14180d0040 0x7f14180d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55756/0 (socket says 172.21.15.143:55756) 2024-05-08T10:24:38.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.376+0000 7f141e6fc640 1 -- 172.21.15.143:0/1485573512 learned_addr learned my addr 172.21.15.143:0/1485573512 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:38.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.376+0000 7f141d6fa640 1 --2- 172.21.15.143:0/1485573512 >> v2:172.21.15.163:3300/0 conn(0x7f14180d3640 0x7f14180d4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.376+0000 7f141e6fc640 1 -- 172.21.15.143:0/1485573512 >> v2:172.21.15.163:3300/0 conn(0x7f14180d3640 msgr2=0x7f14180d4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:38.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.376+0000 7f141e6fc640 1 --2- 172.21.15.143:0/1485573512 >> v2:172.21.15.163:3300/0 conn(0x7f14180d3640 0x7f14180d4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.376+0000 7f141e6fc640 1 -- 172.21.15.143:0/1485573512 >> v1:172.21.15.163:6789/0 conn(0x7f141815f410 legacy=0x7f14180bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.376+0000 7f141e6fc640 1 -- 172.21.15.143:0/1485573512 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14180d43c0 con 0x7f14180d0040 2024-05-08T10:24:38.362 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.376+0000 7f141d6fa640 1 --2- 172.21.15.143:0/1485573512 >> v2:172.21.15.163:3300/0 conn(0x7f14180d3640 0x7f14180d4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:38.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f141e6fc640 1 --2- 172.21.15.143:0/1485573512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d0040 0x7f14180d04f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f14180d0bb0 tx=0x7f141002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da10511f626df7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f141cef9640 1 -- 172.21.15.143:0/1485573512 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410037070 con 0x7f14180d0040 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f141cef9640 1 -- 172.21.15.143:0/1485573512 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1410032440 con 0x7f14180d0040 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f141cef9640 1 -- 172.21.15.143:0/1485573512 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410032810 con 0x7f14180d0040 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f142015f640 1 -- 172.21.15.143:0/1485573512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d0040 msgr2=0x7f14180d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f142015f640 1 --2- 172.21.15.143:0/1485573512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d0040 0x7f14180d04f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f14180d0bb0 tx=0x7f141002a270 comp rx=0 tx=0).stop 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f142015f640 1 -- 172.21.15.143:0/1485573512 shutdown_connections 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f142015f640 1 --2- 172.21.15.143:0/1485573512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d0040 0x7f14180d04f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f142015f640 1 --2- 172.21.15.143:0/1485573512 >> v2:172.21.15.163:3300/0 conn(0x7f14180d3640 0x7f14180d4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.377+0000 7f142015f640 1 -- 172.21.15.143:0/1485573512 >> 172.21.15.143:0/1485573512 conn(0x7f1418073e40 msgr2=0x7f1418074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.378+0000 7f142015f640 1 -- 172.21.15.143:0/1485573512 shutdown_connections 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.378+0000 7f142015f640 1 -- 172.21.15.143:0/1485573512 wait complete. 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.379+0000 7f142015f640 1 Processor -- start 2024-05-08T10:24:38.364 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.379+0000 7f142015f640 1 -- start start 2024-05-08T10:24:38.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.379+0000 7f142015f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14180d0040 0x7f14180b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.379+0000 7f142015f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d3640 0x7f14180b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.379+0000 7f142015f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f141815f410 0x7f141814c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.379+0000 7f142015f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f141815f970 con 0x7f14180d3640 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.379+0000 7f142015f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f141815f7f0 con 0x7f14180d0040 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.379+0000 7f142015f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f14180b83a0 con 0x7f141815f410 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.379+0000 7f141d6fa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d3640 0x7f14180b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f141d6fa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d3640 0x7f14180b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55770/0 (socket says 172.21.15.143:55770) 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f141d6fa640 1 -- 172.21.15.143:0/3788871111 learned_addr learned my addr 172.21.15.143:0/3788871111 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f141d6fa640 1 -- 172.21.15.143:0/3788871111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f141815f410 msgr2=0x7f141814c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f141d6fa640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f141815f410 0x7f141814c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f141d6fa640 1 -- 172.21.15.143:0/3788871111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14180d0040 msgr2=0x7f14180b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f141d6fa640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14180d0040 0x7f14180b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.367 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f141d6fa640 1 -- 172.21.15.143:0/3788871111 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14180b51b0 con 0x7f14180d3640 2024-05-08T10:24:38.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f141d6fa640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d3640 0x7f14180b6250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f140800e810 tx=0x7f140800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f140e7fc640 1 -- 172.21.15.143:0/3788871111 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140800f040 con 0x7f14180d3640 2024-05-08T10:24:38.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f140e7fc640 1 -- 172.21.15.143:0/3788871111 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1408004030 con 0x7f14180d3640 2024-05-08T10:24:38.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14180b5490 con 0x7f14180d3640 2024-05-08T10:24:38.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f140e7fc640 1 -- 172.21.15.143:0/3788871111 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408004400 con 0x7f14180d3640 2024-05-08T10:24:38.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.380+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14180b5d30 con 0x7f14180d3640 2024-05-08T10:24:38.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.381+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14180b5880 con 0x7f14180d3640 2024-05-08T10:24:38.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.382+0000 7f140e7fc640 1 -- 172.21.15.143:0/3788871111 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f140800c6d0 con 0x7f14180d3640 2024-05-08T10:24:38.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.382+0000 7f140e7fc640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f13fc0762d0 0x7f13fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:38.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.382+0000 7f140e7fc640 1 -- 172.21.15.143:0/3788871111 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f14080972b0 con 0x7f14180d3640 2024-05-08T10:24:38.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.382+0000 7f141defb640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f13fc0762d0 0x7f13fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:38.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.383+0000 7f141defb640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f13fc0762d0 0x7f13fc078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f14140012e0 tx=0x7f1414007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:38.371 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.387+0000 7f140e7fc640 1 -- 172.21.15.143:0/3788871111 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1408017020 con 0x7f14180d3640 2024-05-08T10:24:38.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.610+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f141806a4b0 con 0x7f14180d3640 2024-05-08T10:24:38.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.611+0000 7f140e7fc640 1 -- 172.21.15.143:0/3788871111 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f1408060c10 con 0x7f14180d3640 2024-05-08T10:24:38.596 INFO:teuthology.orchestra.run.smithi143.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:24:38.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f13fc0762d0 msgr2=0x7f13fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f13fc0762d0 0x7f13fc078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f14140012e0 tx=0x7f1414007d30 comp rx=0 tx=0).stop 2024-05-08T10:24:38.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d3640 msgr2=0x7f14180b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:38.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d3640 0x7f14180b6250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f140800e810 tx=0x7f140800ecd0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 shutdown_connections 2024-05-08T10:24:38.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f141815f410 0x7f141814c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f13fc0762d0 0x7f13fc078790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14180d3640 0x7f14180b6250 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 --2- 172.21.15.143:0/3788871111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14180d0040 0x7f14180b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:38.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 >> 172.21.15.143:0/3788871111 conn(0x7f1418073e40 msgr2=0x7f14180b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:38.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 shutdown_connections 2024-05-08T10:24:38.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38.613+0000 7f142015f640 1 -- 172.21.15.143:0/3788871111 wait complete. 2024-05-08T10:24:38.609 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-08T10:24:38.609 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:24:38.609 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2024-05-08T10:24:38.609 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T10:24:38.609 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:38.609 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-08T10:24:38.609 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-08T10:24:38.609 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:24:38.609 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:24:38.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:38.610 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2024-05-08T10:24:38.626 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42684sec preferred_lft 42684sec 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether a2:a5:88:4b:73:e0 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T10:24:38.627 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::8408:c6ff:fe90:3d18/64 scope link 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether ee:3b:86:30:cb:a3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec3b:86ff:fe30:cba3/64 scope link 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether a2:a5:88:4b:73:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::a0a5:88ff:fe4b:73e0/64 scope link 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:24:38.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:38.629 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:24:38.690 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-05-08T10:24:38.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:38.691 DEBUG:teuthology.orchestra.run.smithi143:> route 2024-05-08T10:24:38.747 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2024-05-08T10:24:38.747 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:24:38.747 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T10:24:38.747 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T10:24:38.748 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:24:38.748 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:24:38.748 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-05-08T10:24:38.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T10:24:38.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T10:24:38.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T10:24:38.748 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-05-08T10:24:38.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:24:38.868 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:38.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:38.875 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-05-08T10:24:38.890 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T10:24:38.890 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T10:24:38.890 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:24:38.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:38.891 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2024-05-08T10:24:38.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:38.956 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:39.011 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:24:39.012 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:24:39.012 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:39.066 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-08T10:24:39.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:39.067 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:39.150 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:39.150 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:39.158 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:24:39.158 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:24:39.158 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.143:3300,172.21.15.163:3300,172.21.15.163:3301" 2024-05-08T10:24:39.158 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 0@aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64.cephfs=/ 2024-05-08T10:24:39.158 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.143:3300/172.21.15.163:3300/172.21.15.163:3301" will pass to kernel 2024-05-08T10:24:39.158 INFO:teuthology.orchestra.run.smithi143.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-08T10:24:39.158 INFO:teuthology.orchestra.run.smithi143.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:24:39.159 INFO:teuthology.orchestra.run.smithi143.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:24:39.159 INFO:teuthology.orchestra.run.smithi143.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:24:39.159 INFO:teuthology.orchestra.run.smithi143.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:24:39.160 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:24:39.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:39.161 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:39.226 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:24:39.317 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:24:39.322 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:39.328 INFO:teuthology.orchestra.run.smithi143.stdout:client4998 2024-05-08T10:24:39.328 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:39.328 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:39.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:39.344 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir mydir) 2024-05-08T10:24:39.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:39.404 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch mydir/alpha) 2024-05-08T10:24:39.461 DEBUG:teuthology.orchestra.run.smithi143:> stdin-killer -- python3 -c ' 2024-05-08T10:24:39.531 DEBUG:teuthology.orchestra.run.smithi143:> import os 2024-05-08T10:24:39.531 DEBUG:teuthology.orchestra.run.smithi143:> import stat 2024-05-08T10:24:39.531 DEBUG:teuthology.orchestra.run.smithi143:> 2024-05-08T10:24:39.532 DEBUG:teuthology.orchestra.run.smithi143:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir").st_ino) 2024-05-08T10:24:39.532 DEBUG:teuthology.orchestra.run.smithi143:> ' 2024-05-08T10:24:39.597 INFO:teuthology.orchestra.run.smithi143.stdout:1099511627776 2024-05-08T10:24:39.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:39.607 DEBUG:teuthology.orchestra.run.smithi143:> stdin-killer -- python3 -c ' 2024-05-08T10:24:39.607 DEBUG:teuthology.orchestra.run.smithi143:> import os 2024-05-08T10:24:39.607 DEBUG:teuthology.orchestra.run.smithi143:> import stat 2024-05-08T10:24:39.607 DEBUG:teuthology.orchestra.run.smithi143:> 2024-05-08T10:24:39.607 DEBUG:teuthology.orchestra.run.smithi143:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir/alpha").st_ino) 2024-05-08T10:24:39.607 DEBUG:teuthology.orchestra.run.smithi143:> ' 2024-05-08T10:24:39.713 INFO:teuthology.orchestra.run.smithi143.stdout:1099511627777 2024-05-08T10:24:39.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:24:39.722 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:39.722 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:39.778 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:39.778 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:39.833 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:24:39.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.989+0000 7f987bce3640 1 Processor -- start 2024-05-08T10:24:39.974 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.989+0000 7f987bce3640 1 -- start start 2024-05-08T10:24:39.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.990+0000 7f987bce3640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98740d1260 0x7f98740d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:39.976 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.990+0000 7f987bce3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f987415d3d0 0x7f987406e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:39.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.990+0000 7f987bce3640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98740d1b80 con 0x7f987406e8c0 2024-05-08T10:24:39.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.990+0000 7f987bce3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f98740aff30 con 0x7f987415d3d0 2024-05-08T10:24:39.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.990+0000 7f987bce3640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f98740b0210 con 0x7f98740d1260 2024-05-08T10:24:39.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.990+0000 7f987927e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f987415d3d0 0x7f987406e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:39.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.990+0000 7f987927e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f987415d3d0 0x7f987406e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55784/0 (socket says 172.21.15.143:55784) 2024-05-08T10:24:39.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.990+0000 7f987927e640 1 -- 172.21.15.143:0/695071354 learned_addr learned my addr 172.21.15.143:0/695071354 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:39.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.991+0000 7f9879a7f640 1 --2- 172.21.15.143:0/695071354 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98740d1260 0x7f98740d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:39.977 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.991+0000 7f987927e640 1 -- 172.21.15.143:0/695071354 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98740d1260 msgr2=0x7f98740d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:39.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.991+0000 7f987927e640 1 --2- 172.21.15.143:0/695071354 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98740d1260 0x7f98740d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:39.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.991+0000 7f987927e640 1 -- 172.21.15.143:0/695071354 >> v1:172.21.15.163:6789/0 conn(0x7f987406e8c0 legacy=0x7f987415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:39.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.991+0000 7f987927e640 1 -- 172.21.15.143:0/695071354 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98740b04f0 con 0x7f987415d3d0 2024-05-08T10:24:39.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.991+0000 7f987927e640 1 --2- 172.21.15.143:0/695071354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 0x7f987406e380 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9864009870 tx=0x7f986402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d582ae9b972376f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:39.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.991+0000 7f9878a7d640 1 -- 172.21.15.143:0/695071354 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864037070 con 0x7f987415d3d0 2024-05-08T10:24:39.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f9878a7d640 1 -- 172.21.15.143:0/695071354 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9864032440 con 0x7f987415d3d0 2024-05-08T10:24:39.978 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f9878a7d640 1 -- 172.21.15.143:0/695071354 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864032810 con 0x7f987415d3d0 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f987bce3640 1 -- 172.21.15.143:0/695071354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 msgr2=0x7f987406e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f987bce3640 1 --2- 172.21.15.143:0/695071354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 0x7f987406e380 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9864009870 tx=0x7f986402a270 comp rx=0 tx=0).stop 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f987bce3640 1 -- 172.21.15.143:0/695071354 shutdown_connections 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f987bce3640 1 --2- 172.21.15.143:0/695071354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 0x7f987406e380 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f987bce3640 1 --2- 172.21.15.143:0/695071354 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98740d1260 0x7f98740d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f987bce3640 1 -- 172.21.15.143:0/695071354 >> 172.21.15.143:0/695071354 conn(0x7f987406c740 msgr2=0x7f987406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f987bce3640 1 -- 172.21.15.143:0/695071354 shutdown_connections 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.992+0000 7f987bce3640 1 -- 172.21.15.143:0/695071354 wait complete. 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.993+0000 7f987bce3640 1 Processor -- start 2024-05-08T10:24:39.981 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.993+0000 7f987bce3640 1 -- start start 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987bce3640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f987406e8c0 0x7f98740c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987bce3640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98740d1260 0x7f987409dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987bce3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 0x7f987415e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987bce3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f98740afb50 con 0x7f987415d3d0 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987bce3640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f987415d8b0 con 0x7f98740d1260 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987bce3640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f98740afcd0 con 0x7f987406e8c0 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987a280640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 0x7f987415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987a280640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 0x7f987415e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55794/0 (socket says 172.21.15.143:55794) 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987a280640 1 -- 172.21.15.143:0/1261131458 learned_addr learned my addr 172.21.15.143:0/1261131458 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987a280640 1 -- 172.21.15.143:0/1261131458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f987406e8c0 msgr2=0x7f98740c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987a280640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f987406e8c0 0x7f98740c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:39.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987a280640 1 -- 172.21.15.143:0/1261131458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98740d1260 msgr2=0x7f987409dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:39.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987a280640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98740d1260 0x7f987409dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:39.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.994+0000 7f987a280640 1 -- 172.21.15.143:0/1261131458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98741f32f0 con 0x7f987415d3d0 2024-05-08T10:24:39.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.995+0000 7f987a280640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 0x7f987415e420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f986c00c3c0 tx=0x7f986c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:39.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.995+0000 7f986a7fc640 1 -- 172.21.15.143:0/1261131458 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c017070 con 0x7f987415d3d0 2024-05-08T10:24:39.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.995+0000 7f986a7fc640 1 -- 172.21.15.143:0/1261131458 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986c0052d0 con 0x7f987415d3d0 2024-05-08T10:24:39.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.995+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98741f35d0 con 0x7f987415d3d0 2024-05-08T10:24:39.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.995+0000 7f986a7fc640 1 -- 172.21.15.143:0/1261131458 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c003810 con 0x7f987415d3d0 2024-05-08T10:24:39.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.995+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98741f3b90 con 0x7f987415d3d0 2024-05-08T10:24:39.983 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.996+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98740c6430 con 0x7f987415d3d0 2024-05-08T10:24:39.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.996+0000 7f986a7fc640 1 -- 172.21.15.143:0/1261131458 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f986c01a070 con 0x7f987415d3d0 2024-05-08T10:24:39.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.997+0000 7f986a7fc640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f98580762d0 0x7f9858078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:39.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.997+0000 7f9879a7f640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f98580762d0 0x7f9858078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:39.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.997+0000 7f986a7fc640 1 -- 172.21.15.143:0/1261131458 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f986c096970 con 0x7f987415d3d0 2024-05-08T10:24:39.984 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:39.997+0000 7f9879a7f640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f98580762d0 0x7f9858078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98700070b0 tx=0x7f9870007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:39.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.001+0000 7f986a7fc640 1 -- 172.21.15.143:0/1261131458 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f98740c6430 con 0x7f987415d3d0 2024-05-08T10:24:40.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.196+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f987406a4b0 con 0x7f987415d3d0 2024-05-08T10:24:40.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.196+0000 7f986a7fc640 1 -- 172.21.15.143:0/1261131458 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) ==== 80+0+0 (secure 0 0 0) 0x7f986c060380 con 0x7f987415d3d0 2024-05-08T10:24:40.182 INFO:teuthology.orchestra.run.smithi143.stderr:listed 0 entries 2024-05-08T10:24:40.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f98580762d0 msgr2=0x7f9858078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f98580762d0 0x7f9858078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98700070b0 tx=0x7f9870007040 comp rx=0 tx=0).stop 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 msgr2=0x7f987415e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 0x7f987415e420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f986c00c3c0 tx=0x7f986c00c880 comp rx=0 tx=0).stop 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 shutdown_connections 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f98580762d0 0x7f9858078790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f987415d3d0 0x7f987415e420 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98740d1260 0x7f987409dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 --2- 172.21.15.143:0/1261131458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f987406e8c0 0x7f98740c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 >> 172.21.15.143:0/1261131458 conn(0x7f987406c740 msgr2=0x7f987406cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 shutdown_connections 2024-05-08T10:24:40.184 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.198+0000 7f987bce3640 1 -- 172.21.15.143:0/1261131458 wait complete. 2024-05-08T10:24:40.195 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T10:24:40.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:40.195 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-08T10:24:40.237 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:24:40.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:40.238 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T10:24:40.294 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-05-08T10:24:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.392+0000 7fc3718b1f40 1 Processor -- start 2024-05-08T10:24:40.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.392+0000 7fc3718b1f40 1 -- start start 2024-05-08T10:24:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc3718b1f40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 0x55568bd96cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc3718b1f40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd077d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc3718b1f40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55568bd8e4d0 0x55568bd964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc3718b1f40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55568bc68f50 con 0x55568bcf17f0 2024-05-08T10:24:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc3718b1f40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55568bc6cf90 con 0x55568bd8e4d0 2024-05-08T10:24:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc3718b1f40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55568bd098f0 con 0x55568bced180 2024-05-08T10:24:40.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc367fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc367fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd077d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55812/0 (socket says 172.21.15.143:55812) 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc367fff640 1 -- 172.21.15.143:0/4294636862 learned_addr learned my addr 172.21.15.143:0/4294636862 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc36fbae640 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55568bd8e4d0 0x55568bd964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc36f3ad640 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 0x55568bd96cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc367fff640 1 -- 172.21.15.143:0/4294636862 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 msgr2=0x55568bd96cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc367fff640 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 0x55568bd96cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc367fff640 1 -- 172.21.15.143:0/4294636862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55568bd8e4d0 msgr2=0x55568bd964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc367fff640 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55568bd8e4d0 0x55568bd964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc367fff640 1 -- 172.21.15.143:0/4294636862 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55568bd8db80 con 0x55568bcf17f0 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc36f3ad640 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 0x55568bd96cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc367fff640 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd077d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc3580460a0 tx=0x7fc358051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efdda695c278da0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc36e3ab640 1 -- 172.21.15.143:0/4294636862 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3580508a0 con 0x55568bcf17f0 2024-05-08T10:24:40.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc36e3ab640 1 -- 172.21.15.143:0/4294636862 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc358050a60 con 0x55568bcf17f0 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.393+0000 7fc36e3ab640 1 -- 172.21.15.143:0/4294636862 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358050e50 con 0x55568bcf17f0 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 -- 172.21.15.143:0/4294636862 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 msgr2=0x55568bd077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd077d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc3580460a0 tx=0x7fc358051000 comp rx=0 tx=0).stop 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 -- 172.21.15.143:0/4294636862 shutdown_connections 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55568bd8e4d0 0x55568bd964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd077d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 --2- 172.21.15.143:0/4294636862 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 0x55568bd96cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 -- 172.21.15.143:0/4294636862 >> 172.21.15.143:0/4294636862 conn(0x55568bd0bf10 msgr2=0x55568bcf10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 -- 172.21.15.143:0/4294636862 shutdown_connections 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 -- 172.21.15.143:0/4294636862 wait complete. 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.394+0000 7fc3718b1f40 1 Processor -- start 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc3718b1f40 1 -- start start 2024-05-08T10:24:40.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc3718b1f40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 0x55568bceb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc3718b1f40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd86350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc3718b1f40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55568bd8e4d0 0x55568bd847a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc3718b1f40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55568bd07d10 con 0x55568bcf17f0 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc3718b1f40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55568bd971f0 con 0x55568bd8e4d0 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc3718b1f40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55568bceb320 con 0x55568bced180 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc367fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd86350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc367fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd86350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55822/0 (socket says 172.21.15.143:55822) 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc367fff640 1 -- 172.21.15.143:0/3856382022 learned_addr learned my addr 172.21.15.143:0/3856382022 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc36f3ad640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 0x55568bceb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.395+0000 7fc36fbae640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55568bd8e4d0 0x55568bd847a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc367fff640 1 -- 172.21.15.143:0/3856382022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 msgr2=0x55568bceb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc367fff640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55568bced180 0x55568bceb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc367fff640 1 -- 172.21.15.143:0/3856382022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55568bd8e4d0 msgr2=0x55568bd847a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc367fff640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55568bd8e4d0 0x55568bd847a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc367fff640 1 -- 172.21.15.143:0/3856382022 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55568bcec030 con 0x55568bcf17f0 2024-05-08T10:24:40.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc367fff640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd86350 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc358025df0 tx=0x7fc358003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc36d3a9640 1 -- 172.21.15.143:0/3856382022 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3580508a0 con 0x55568bcf17f0 2024-05-08T10:24:40.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc36d3a9640 1 -- 172.21.15.143:0/3856382022 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc358063410 con 0x55568bcf17f0 2024-05-08T10:24:40.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55568bcec310 con 0x55568bcf17f0 2024-05-08T10:24:40.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc36d3a9640 1 -- 172.21.15.143:0/3856382022 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3580637e0 con 0x55568bcf17f0 2024-05-08T10:24:40.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.396+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55568bcec8d0 con 0x55568bcf17f0 2024-05-08T10:24:40.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:24:40.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.397+0000 7fc36d3a9640 1 -- 172.21.15.143:0/3856382022 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc358063980 con 0x55568bcf17f0 2024-05-08T10:24:40.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.398+0000 7fc36d3a9640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc350074cb0 0x7fc350077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.398+0000 7fc36d3a9640 1 -- 172.21.15.143:0/3856382022 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc3580db010 con 0x55568bcf17f0 2024-05-08T10:24:40.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.398+0000 7fc36f3ad640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc350074cb0 0x7fc350077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.398+0000 7fc3718b1f40 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55568bd9a110 0x55568bd9a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.398+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 --> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55568bd9aa60 con 0x55568bd9a110 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.398+0000 7fc36fbae640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55568bd9a110 0x55568bd9a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.398+0000 7fc36f3ad640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc350074cb0 0x7fc350077170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55568bd8e480 tx=0x7fc360001e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc36fbae640 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55568bd9a110 0x55568bd9a520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc36fbae640 1 -- 172.21.15.143:0/3856382022 <== osd.3 v2:172.21.15.143:6824/2042563744 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7fc3680068f0 con 0x55568bd9a110 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:error getting omap key set cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55568bd9a110 msgr2=0x55568bd9a520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55568bd9a110 0x55568bd9a520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc350074cb0 msgr2=0x7fc350077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc350074cb0 0x7fc350077170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55568bd8e480 tx=0x7fc360001e30 comp rx=0 tx=0).stop 2024-05-08T10:24:40.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 msgr2=0x55568bd86350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 --2- 172.21.15.143:0/3856382022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55568bcf17f0 0x55568bd86350 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc358025df0 tx=0x7fc358003020 comp rx=0 tx=0).stop 2024-05-08T10:24:40.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc36fbae640 1 -- 172.21.15.143:0/3856382022 reap_dead start 2024-05-08T10:24:40.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 shutdown_connections 2024-05-08T10:24:40.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 >> 172.21.15.143:0/3856382022 conn(0x55568bd0bf10 msgr2=0x55568bd07e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:40.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 shutdown_connections 2024-05-08T10:24:40.391 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.399+0000 7fc3718b1f40 1 -- 172.21.15.143:0/3856382022 wait complete. 2024-05-08T10:24:40.391 ERROR:tasks.cephfs.filesystem:Command failed on smithi143 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000' 2024-05-08T10:24:40.391 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-08T10:24:40.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.489+0000 7f298fa0bf40 1 Processor -- start 2024-05-08T10:24:40.474 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.489+0000 7f298fa0bf40 1 -- start start 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298fa0bf40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c5be1a24b0 0x55c5be1a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298fa0bf40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c5be277a90 0x55c5be26d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298fa0bf40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277e70 0x55c5be26de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298fa0bf40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c5be1a2920 con 0x55c5be277e70 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298fa0bf40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55c5be147f50 con 0x55c5be277a90 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298fa0bf40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55c5be1cfb60 con 0x55c5be1a24b0 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298d068640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277e70 0x55c5be26de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298d068640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277e70 0x55c5be26de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55834/0 (socket says 172.21.15.143:55834) 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298d068640 1 -- 172.21.15.143:0/2365145521 learned_addr learned my addr 172.21.15.143:0/2365145521 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f2984066640 1 --2- 172.21.15.143:0/2365145521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c5be277a90 0x55c5be26d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298c867640 1 --2- 172.21.15.143:0/2365145521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c5be1a24b0 0x55c5be1a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298d068640 1 -- 172.21.15.143:0/2365145521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c5be1a24b0 msgr2=0x55c5be1a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:40.479 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298d068640 1 --2- 172.21.15.143:0/2365145521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c5be1a24b0 0x55c5be1a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298d068640 1 -- 172.21.15.143:0/2365145521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c5be277a90 msgr2=0x55c5be26d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298d068640 1 --2- 172.21.15.143:0/2365145521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c5be277a90 0x55c5be26d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298d068640 1 -- 172.21.15.143:0/2365145521 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5be26ea30 con 0x55c5be277e70 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f298d068640 1 --2- 172.21.15.143:0/2365145521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277e70 0x55c5be26de60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2988001b90 tx=0x7f29880069f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6e25e609419b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f29877fe640 1 -- 172.21.15.143:0/2365145521 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988016070 con 0x55c5be277e70 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f29877fe640 1 -- 172.21.15.143:0/2365145521 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2988004540 con 0x55c5be277e70 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.490+0000 7f29877fe640 1 -- 172.21.15.143:0/2365145521 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988004970 con 0x55c5be277e70 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 -- 172.21.15.143:0/2365145521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277e70 msgr2=0x55c5be26de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 --2- 172.21.15.143:0/2365145521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277e70 0x55c5be26de60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2988001b90 tx=0x7f29880069f0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 -- 172.21.15.143:0/2365145521 shutdown_connections 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 --2- 172.21.15.143:0/2365145521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277e70 0x55c5be26de60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 --2- 172.21.15.143:0/2365145521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c5be277a90 0x55c5be26d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 --2- 172.21.15.143:0/2365145521 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c5be1a24b0 0x55c5be1a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.480 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 -- 172.21.15.143:0/2365145521 >> 172.21.15.143:0/2365145521 conn(0x55c5be1eaf10 msgr2=0x55c5be1eb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 -- 172.21.15.143:0/2365145521 shutdown_connections 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 -- 172.21.15.143:0/2365145521 wait complete. 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 Processor -- start 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.491+0000 7f298fa0bf40 1 -- start start 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f298fa0bf40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c5be1a24b0 0x55c5be1a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f298fa0bf40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277a90 0x55c5be273b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f298fa0bf40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c5be277e70 0x55c5be271e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f298fa0bf40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c5be1e5730 con 0x55c5be277a90 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f298fa0bf40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55c5be1e0740 con 0x55c5be277e70 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f298fa0bf40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55c5be26e700 con 0x55c5be1a24b0 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f2984066640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277a90 0x55c5be273b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f2984066640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277a90 0x55c5be273b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55838/0 (socket says 172.21.15.143:55838) 2024-05-08T10:24:40.481 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f2984066640 1 -- 172.21.15.143:0/3029935022 learned_addr learned my addr 172.21.15.143:0/3029935022 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f298c867640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c5be1a24b0 0x55c5be1a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f298d068640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c5be277e70 0x55c5be271e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f2984066640 1 -- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c5be1a24b0 msgr2=0x55c5be1a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f2984066640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c5be1a24b0 0x55c5be1a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f2984066640 1 -- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c5be277e70 msgr2=0x55c5be271e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f2984066640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c5be277e70 0x55c5be271e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.492+0000 7f2984066640 1 -- 172.21.15.143:0/3029935022 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5be1e6130 con 0x55c5be277a90 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.493+0000 7f2984066640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277a90 0x55c5be273b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2974008770 tx=0x7f2974008860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.493+0000 7f29867fc640 1 -- 172.21.15.143:0/3029935022 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740148a0 con 0x55c5be277a90 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.493+0000 7f29867fc640 1 -- 172.21.15.143:0/3029935022 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297401a070 con 0x55c5be277a90 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.493+0000 7f29867fc640 1 -- 172.21.15.143:0/3029935022 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974014c40 con 0x55c5be277a90 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.493+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5be26d850 con 0x55c5be277a90 2024-05-08T10:24:40.482 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.493+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5be271a00 con 0x55c5be277a90 2024-05-08T10:24:40.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:24:40.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.494+0000 7f29867fc640 1 -- 172.21.15.143:0/3029935022 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2974015470 con 0x55c5be277a90 2024-05-08T10:24:40.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.495+0000 7f29867fc640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f296c074cb0 0x7f296c077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.495+0000 7f298c867640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f296c074cb0 0x7f296c077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.495+0000 7f29867fc640 1 -- 172.21.15.143:0/3029935022 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2974096ae0 con 0x55c5be277a90 2024-05-08T10:24:40.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.495+0000 7f298fa0bf40 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55c5be1e9a30 0x55c5be1e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.495+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 --> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c5be269bb0 con 0x55c5be1e9a30 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.495+0000 7f298c867640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f296c074cb0 0x7f296c077170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f297c056000 tx=0x7f297c050000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.495+0000 7f298d068640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55c5be1e9a30 0x55c5be1e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.495+0000 7f298d068640 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55c5be1e9a30 0x55c5be1e9e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298d068640 1 -- 172.21.15.143:0/3029935022 <== osd.5 v2:172.21.15.163:6800/688232145 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f298800f070 con 0x55c5be1e9a30 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:error getting xattr cephfs_data/10000000001.00000000/parent: (2) No such file or directory 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55c5be1e9a30 msgr2=0x55c5be1e9e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55c5be1e9a30 0x55c5be1e9e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f296c074cb0 msgr2=0x7f296c077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f296c074cb0 0x7f296c077170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f297c056000 tx=0x7f297c050000 comp rx=0 tx=0).stop 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277a90 msgr2=0x55c5be273b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 --2- 172.21.15.143:0/3029935022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c5be277a90 0x55c5be273b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2974008770 tx=0x7f2974008860 comp rx=0 tx=0).stop 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298d068640 1 -- 172.21.15.143:0/3029935022 reap_dead start 2024-05-08T10:24:40.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 shutdown_connections 2024-05-08T10:24:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 >> 172.21.15.143:0/3029935022 conn(0x55c5be1eaf10 msgr2=0x55c5be1e0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 shutdown_connections 2024-05-08T10:24:40.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.496+0000 7f298fa0bf40 1 -- 172.21.15.143:0/3029935022 wait complete. 2024-05-08T10:24:40.487 ERROR:tasks.cephfs.filesystem:Command failed on smithi143 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent' 2024-05-08T10:24:40.487 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-05-08T10:24:40.530 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.545+0000 7f368920bf40 1 Processor -- start 2024-05-08T10:24:40.531 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.545+0000 7f368920bf40 1 -- start start 2024-05-08T10:24:40.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f368920bf40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3674003b00 0x55c702e286f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f368920bf40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c702d91480 0x55c702d8f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f368920bf40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c702d62530 0x55c702d8fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f368920bf40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c702d09f50 con 0x7f3674003b00 2024-05-08T10:24:40.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f368920bf40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55c702d0df90 con 0x55c702d91480 2024-05-08T10:24:40.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f368920bf40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55c702d63170 con 0x55c702d62530 2024-05-08T10:24:40.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f3686029640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3674003b00 0x55c702e286f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f3686029640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3674003b00 0x55c702e286f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55850/0 (socket says 172.21.15.143:55850) 2024-05-08T10:24:40.533 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f3686029640 1 -- 172.21.15.143:0/3244768302 learned_addr learned my addr 172.21.15.143:0/3244768302 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f3686029640 1 -- 172.21.15.143:0/3244768302 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c702d62530 msgr2=0x55c702d8fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f3686029640 1 --2- 172.21.15.143:0/3244768302 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c702d62530 0x55c702d8fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f3686029640 1 -- 172.21.15.143:0/3244768302 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c702d91480 msgr2=0x55c702d8f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f3686029640 1 --2- 172.21.15.143:0/3244768302 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c702d91480 0x55c702d8f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.546+0000 7f3686029640 1 -- 172.21.15.143:0/3244768302 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c702e391f0 con 0x7f3674003b00 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f3686029640 1 --2- 172.21.15.143:0/3244768302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3674003b00 0x55c702e286f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3678001890 tx=0x7f3678009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75154ab23d62af71 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f3685027640 1 -- 172.21.15.143:0/3244768302 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367800e820 con 0x7f3674003b00 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f3685027640 1 -- 172.21.15.143:0/3244768302 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3678013030 con 0x7f3674003b00 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f3685027640 1 -- 172.21.15.143:0/3244768302 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367800ebe0 con 0x7f3674003b00 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f368920bf40 1 -- 172.21.15.143:0/3244768302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3674003b00 msgr2=0x55c702e286f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f368920bf40 1 --2- 172.21.15.143:0/3244768302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3674003b00 0x55c702e286f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3678001890 tx=0x7f3678009ad0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f368920bf40 1 -- 172.21.15.143:0/3244768302 shutdown_connections 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f368920bf40 1 --2- 172.21.15.143:0/3244768302 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c702d62530 0x55c702d8fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.534 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f368920bf40 1 --2- 172.21.15.143:0/3244768302 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c702d91480 0x55c702d8f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f368920bf40 1 --2- 172.21.15.143:0/3244768302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3674003b00 0x55c702e286f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f368920bf40 1 -- 172.21.15.143:0/3244768302 >> 172.21.15.143:0/3244768302 conn(0x55c702d60d10 msgr2=0x55c702d90d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:40.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f368920bf40 1 -- 172.21.15.143:0/3244768302 shutdown_connections 2024-05-08T10:24:40.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.547+0000 7f368920bf40 1 -- 172.21.15.143:0/3244768302 wait complete. 2024-05-08T10:24:40.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.548+0000 7f368920bf40 1 Processor -- start 2024-05-08T10:24:40.535 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.548+0000 7f368920bf40 1 -- start start 2024-05-08T10:24:40.538 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.548+0000 7f368920bf40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c702d62530 0x55c702e2a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.548+0000 7f368920bf40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c702d91480 0x55c702e2b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.548+0000 7f368920bf40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3674003b00 0x55c702e2b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.548+0000 7f368920bf40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c702d8c310 con 0x55c702d62530 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.548+0000 7f368920bf40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55c702d8d9e0 con 0x55c702d91480 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.548+0000 7f368920bf40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55c702d8c030 con 0x7f3674003b00 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f3686029640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c702d62530 0x55c702e2a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f3686029640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c702d62530 0x55c702e2a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55866/0 (socket says 172.21.15.143:55866) 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f3686029640 1 -- 172.21.15.143:0/2558202193 learned_addr learned my addr 172.21.15.143:0/2558202193 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f367d828640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c702d91480 0x55c702e2b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f368682a640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3674003b00 0x55c702e2b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f3686029640 1 -- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3674003b00 msgr2=0x55c702e2b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f3686029640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3674003b00 0x55c702e2b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.539 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f3686029640 1 -- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c702d91480 msgr2=0x55c702e2b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f3686029640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c702d91480 0x55c702e2b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f3686029640 1 -- 172.21.15.143:0/2558202193 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c702d608d0 con 0x55c702d62530 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f367d828640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c702d91480 0x55c702e2b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f368682a640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3674003b00 0x55c702e2b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f3686029640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c702d62530 0x55c702e2a990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3678000c00 tx=0x7f3678001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f367ffff640 1 -- 172.21.15.143:0/2558202193 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367800eea0 con 0x55c702d62530 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f367ffff640 1 -- 172.21.15.143:0/2558202193 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367800f860 con 0x55c702d62530 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f367ffff640 1 -- 172.21.15.143:0/2558202193 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367800fc50 con 0x55c702d62530 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c702e2e730 con 0x55c702d62530 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.549+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c702e1f1f0 con 0x55c702d62530 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.551+0000 7f367ffff640 1 -- 172.21.15.143:0/2558202193 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3678024070 con 0x55c702d62530 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.551+0000 7f367ffff640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3668074cb0 0x7f3668077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.540 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.551+0000 7f367ffff640 1 -- 172.21.15.143:0/2558202193 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3678098aa0 con 0x55c702d62530 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.551+0000 7f367d828640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3668074cb0 0x7f3668077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.551+0000 7f368920bf40 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c702e25270 0x55c702e292d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.551+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 --> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c702e29810 con 0x55c702e25270 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368682a640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c702e25270 0x55c702e292d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f367d828640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3668074cb0 0x7f3668077170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55c702d91240 tx=0x7f36700022a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368682a640 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c702e25270 0x55c702e292d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368682a640 1 -- 172.21.15.143:0/2558202193 <== osd.6 v2:172.21.15.163:6824/2263704478 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) ==== 154+0+5 (crc 0 0 0) 0x7f368004e4f0 con 0x55c702e25270 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c702e25270 msgr2=0x55c702e292d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368920bf40 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c702e25270 0x55c702e292d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3668074cb0 msgr2=0x7f3668077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368920bf40 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3668074cb0 0x7f3668077170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55c702d91240 tx=0x7f36700022a0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c702d62530 msgr2=0x55c702e2a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368920bf40 1 --2- 172.21.15.143:0/2558202193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c702d62530 0x55c702e2a990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3678000c00 tx=0x7f3678001a30 comp rx=0 tx=0).stop 2024-05-08T10:24:40.541 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368682a640 1 -- 172.21.15.143:0/2558202193 reap_dead start 2024-05-08T10:24:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 shutdown_connections 2024-05-08T10:24:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.552+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 >> 172.21.15.143:0/2558202193 conn(0x55c702d60d10 msgr2=0x55c702e38640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.553+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 shutdown_connections 2024-05-08T10:24:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.553+0000 7f368920bf40 1 -- 172.21.15.143:0/2558202193 wait complete. 2024-05-08T10:24:40.543 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:40.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.697+0000 7f8d300d1640 1 Processor -- start 2024-05-08T10:24:40.682 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.697+0000 7f8d300d1640 1 -- start start 2024-05-08T10:24:40.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d300d1640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8d2815c020 0x7f8d28073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.683 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d300d1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d28072f80 con 0x7f8d280b48b0 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d300d1640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d28074430 con 0x7f8d280ae180 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d300d1640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f8d280ae700 con 0x7f8d2815c020 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d2e66e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8d280b48b0 0x7f8d280afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:35532/0 (socket says 172.21.15.143:35532) 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d2e66e640 1 -- 172.21.15.143:0/1578374886 learned_addr learned my addr 172.21.15.143:0/1578374886 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d2de6d640 1 --2- 172.21.15.143:0/1578374886 >> v2:172.21.15.163:3300/0 conn(0x7f8d2815c020 0x7f8d28073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d2ce6b640 1 -- 172.21.15.143:0/1578374886 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275988092 0 0) 0x7f8d20001110 con 0x7f8d280b48b0 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d2ce6b640 1 -- 172.21.15.143:0/1578374886 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d14003520 con 0x7f8d280b48b0 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d2de6d640 1 -- 172.21.15.143:0/1578374886 >> v1:172.21.15.163:6789/0 conn(0x7f8d280ae180 legacy=0x7f8d280b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d2de6d640 1 -- 172.21.15.143:0/1578374886 >> v1:172.21.15.143:6789/0 conn(0x7f8d280b48b0 legacy=0x7f8d280afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.698+0000 7f8d2de6d640 1 -- 172.21.15.143:0/1578374886 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d28074710 con 0x7f8d2815c020 2024-05-08T10:24:40.685 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.699+0000 7f8d2de6d640 1 --2- 172.21.15.143:0/1578374886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d2815c020 0x7f8d28073720 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d2402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=624ad063b244d454 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.699+0000 7f8d2ce6b640 1 -- 172.21.15.143:0/1578374886 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24031600 con 0x7f8d2815c020 2024-05-08T10:24:40.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.699+0000 7f8d2ce6b640 1 -- 172.21.15.143:0/1578374886 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d240317a0 con 0x7f8d2815c020 2024-05-08T10:24:40.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.699+0000 7f8d2ce6b640 1 -- 172.21.15.143:0/1578374886 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24031b70 con 0x7f8d2815c020 2024-05-08T10:24:40.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.700+0000 7f8d300d1640 1 -- 172.21.15.143:0/1578374886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d2815c020 msgr2=0x7f8d28073720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.700+0000 7f8d300d1640 1 --2- 172.21.15.143:0/1578374886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d2815c020 0x7f8d28073720 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d2402a5d0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.700+0000 7f8d300d1640 1 -- 172.21.15.143:0/1578374886 shutdown_connections 2024-05-08T10:24:40.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.700+0000 7f8d300d1640 1 --2- 172.21.15.143:0/1578374886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d2815c020 0x7f8d28073720 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.700+0000 7f8d300d1640 1 -- 172.21.15.143:0/1578374886 >> 172.21.15.143:0/1578374886 conn(0x7f8d2806c500 msgr2=0x7f8d2806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:40.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.700+0000 7f8d300d1640 1 -- 172.21.15.143:0/1578374886 shutdown_connections 2024-05-08T10:24:40.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.700+0000 7f8d300d1640 1 -- 172.21.15.143:0/1578374886 wait complete. 2024-05-08T10:24:40.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.701+0000 7f8d300d1640 1 Processor -- start 2024-05-08T10:24:40.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.701+0000 7f8d300d1640 1 -- start start 2024-05-08T10:24:40.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d300d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d280ae180 0x7f8d2814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d300d1640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d280b48b0 0x7f8d280b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d300d1640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d2815c020 0x7f8d280b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d300d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2815c400 con 0x7f8d280ae180 2024-05-08T10:24:40.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d300d1640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28073290 con 0x7f8d2815c020 2024-05-08T10:24:40.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d300d1640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8d28073c60 con 0x7f8d280b48b0 2024-05-08T10:24:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2de6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d280ae180 0x7f8d2814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2de6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d280ae180 0x7f8d2814a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55878/0 (socket says 172.21.15.143:55878) 2024-05-08T10:24:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2de6d640 1 -- 172.21.15.143:0/2324007438 learned_addr learned my addr 172.21.15.143:0/2324007438 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2e66e640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d2815c020 0x7f8d280b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2d66c640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d280b48b0 0x7f8d280b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2de6d640 1 -- 172.21.15.143:0/2324007438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d280b48b0 msgr2=0x7f8d280b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2de6d640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d280b48b0 0x7f8d280b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2de6d640 1 -- 172.21.15.143:0/2324007438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d2815c020 msgr2=0x7f8d280b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2de6d640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d2815c020 0x7f8d280b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2de6d640 1 -- 172.21.15.143:0/2324007438 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2809b430 con 0x7f8d280ae180 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2d66c640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d280b48b0 0x7f8d280b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.702+0000 7f8d2de6d640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d280ae180 0x7f8d2814a450 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.703+0000 7f8d1e7fc640 1 -- 172.21.15.143:0/2324007438 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2403f070 con 0x7f8d280ae180 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.703+0000 7f8d1e7fc640 1 -- 172.21.15.143:0/2324007438 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d24030be0 con 0x7f8d280ae180 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.703+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2809b710 con 0x7f8d280ae180 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.703+0000 7f8d1e7fc640 1 -- 172.21.15.143:0/2324007438 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24009450 con 0x7f8d280ae180 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.703+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2809bcd0 con 0x7f8d280ae180 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.704+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d2806a550 con 0x7f8d280ae180 2024-05-08T10:24:40.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.704+0000 7f8d1e7fc640 1 -- 172.21.15.143:0/2324007438 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8d24044460 con 0x7f8d280ae180 2024-05-08T10:24:40.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.705+0000 7f8d1e7fc640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8d0c0762d0 0x7f8d0c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:40.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.705+0000 7f8d1e7fc640 1 -- 172.21.15.143:0/2324007438 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f8d240b8a00 con 0x7f8d280ae180 2024-05-08T10:24:40.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.705+0000 7f8d2d66c640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8d0c0762d0 0x7f8d0c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:40.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.705+0000 7f8d2d66c640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8d0c0762d0 0x7f8d0c078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8d18007fd0 tx=0x7f8d18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:40.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.709+0000 7f8d1e7fc640 1 -- 172.21.15.143:0/2324007438 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8d240823f0 con 0x7f8d280ae180 2024-05-08T10:24:40.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.927+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d2815c840 con 0x7f8d280ae180 2024-05-08T10:24:40.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.928+0000 7f8d1e7fc640 1 -- 172.21.15.143:0/2324007438 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5190 (secure 0 0 0) 0x7f8d24081cf0 con 0x7f8d280ae180 2024-05-08T10:24:40.914 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:40.914 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2519238209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2519238209},{"type":"v1","addr":"172.21.15.163:6834","nonce":2519238209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/420423244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":420423244},{"type":"v1","addr":"172.21.15.163:6835","nonce":420423244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4794,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2143046617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2143046617},{"type":"v1","addr":"172.21.15.143:6836","nonce":2143046617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:24:28.550393+0000","modified":"2024-05-08T10:24:30.548210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4797},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4797":{"gid":4797,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3656674830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3656674830},{"type":"v1","addr":"172.21.15.143:6837","nonce":3656674830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4797,"qdb_cluster":[4797]},"id":2}]} 2024-05-08T10:24:40.914 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 13 2024-05-08T10:24:40.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8d0c0762d0 msgr2=0x7f8d0c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8d0c0762d0 0x7f8d0c078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8d18007fd0 tx=0x7f8d18009040 comp rx=0 tx=0).stop 2024-05-08T10:24:40.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d280ae180 msgr2=0x7f8d2814a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:40.916 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d280ae180 0x7f8d2814a450 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d24004a40 comp rx=0 tx=0).stop 2024-05-08T10:24:40.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 shutdown_connections 2024-05-08T10:24:40.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d2815c020 0x7f8d280b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8d280b48b0 0x7f8d280b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8d0c0762d0 0x7f8d0c078790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 --2- 172.21.15.143:0/2324007438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d280ae180 0x7f8d2814a450 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:40.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 >> 172.21.15.143:0/2324007438 conn(0x7f8d2806c500 msgr2=0x7f8d280b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:40.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 shutdown_connections 2024-05-08T10:24:40.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:40.930+0000 7f8d300d1640 1 -- 172.21.15.143:0/2324007438 wait complete. 2024-05-08T10:24:40.927 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-08T10:24:41.055 INFO:teuthology.orchestra.run.smithi143.stdout:{"message":"","return_code":0} 2024-05-08T10:24:41.056 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-08T10:24:41.056 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-05-08T10:24:41.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.113+0000 7f5536308f40 1 Processor -- start 2024-05-08T10:24:41.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.113+0000 7f5536308f40 1 -- start start 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f5536308f40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5599d1e04680 0x5599d1e43370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f5536308f40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9a90 0x5599d1e43da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f5536308f40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5599d1ed9e70 0x5599d1ed0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f5536308f40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5599d1da9f50 con 0x5599d1ed9a90 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f5536308f40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5599d1dadf90 con 0x5599d1ed9e70 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f5536308f40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x5599d1e32ba0 con 0x5599d1e04680 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f552bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9a90 0x5599d1e43da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f552bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9a90 0x5599d1e43da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55902/0 (socket says 172.21.15.143:55902) 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f552bfff640 1 -- 172.21.15.143:0/3507064253 learned_addr learned my addr 172.21.15.143:0/3507064253 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f552bfff640 1 -- 172.21.15.143:0/3507064253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5599d1e04680 msgr2=0x5599d1e43370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f552bfff640 1 --2- 172.21.15.143:0/3507064253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5599d1e04680 0x5599d1e43370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f552bfff640 1 -- 172.21.15.143:0/3507064253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5599d1ed9e70 msgr2=0x5599d1ed0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f552bfff640 1 --2- 172.21.15.143:0/3507064253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5599d1ed9e70 0x5599d1ed0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f552bfff640 1 -- 172.21.15.143:0/3507064253 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d1e44aa0 con 0x5599d1ed9a90 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f552bfff640 1 --2- 172.21.15.143:0/3507064253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9a90 0x5599d1e43da0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f551c00b290 tx=0x7f551c00b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4ad15a62c336e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f5532e02640 1 -- 172.21.15.143:0/3507064253 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c008070 con 0x5599d1ed9a90 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f5532e02640 1 -- 172.21.15.143:0/3507064253 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c00d500 con 0x5599d1ed9a90 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.114+0000 7f5532e02640 1 -- 172.21.15.143:0/3507064253 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c00d8f0 con 0x5599d1ed9a90 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 -- 172.21.15.143:0/3507064253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9a90 msgr2=0x5599d1e43da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 --2- 172.21.15.143:0/3507064253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9a90 0x5599d1e43da0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f551c00b290 tx=0x7f551c00b750 comp rx=0 tx=0).stop 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 -- 172.21.15.143:0/3507064253 shutdown_connections 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 --2- 172.21.15.143:0/3507064253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5599d1ed9e70 0x5599d1ed0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.102 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 --2- 172.21.15.143:0/3507064253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9a90 0x5599d1e43da0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 --2- 172.21.15.143:0/3507064253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5599d1e04680 0x5599d1e43370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 -- 172.21.15.143:0/3507064253 >> 172.21.15.143:0/3507064253 conn(0x5599d1e4cf10 msgr2=0x5599d1e4bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 -- 172.21.15.143:0/3507064253 shutdown_connections 2024-05-08T10:24:41.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 -- 172.21.15.143:0/3507064253 wait complete. 2024-05-08T10:24:41.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.115+0000 7f5536308f40 1 Processor -- start 2024-05-08T10:24:41.103 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5536308f40 1 -- start start 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5536308f40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5599d1e04680 0x5599d1ed7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5536308f40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5599d1ed9a90 0x5599d1e4bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5536308f40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9e70 0x5599d1e00930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5536308f40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5599d1e444e0 con 0x5599d1ed9e70 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5536308f40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5599d1e447c0 con 0x5599d1e04680 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5536308f40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x5599d1e42b70 con 0x5599d1ed9a90 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5534605640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9e70 0x5599d1e00930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5534605640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9e70 0x5599d1e00930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55904/0 (socket says 172.21.15.143:55904) 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5534605640 1 -- 172.21.15.143:0/672412762 learned_addr learned my addr 172.21.15.143:0/672412762 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f5533e04640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5599d1e04680 0x5599d1ed7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.116+0000 7f552bfff640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5599d1ed9a90 0x5599d1e4bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5534605640 1 -- 172.21.15.143:0/672412762 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5599d1ed9a90 msgr2=0x5599d1e4bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5534605640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x5599d1ed9a90 0x5599d1e4bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5534605640 1 -- 172.21.15.143:0/672412762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5599d1e04680 msgr2=0x5599d1ed7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5534605640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5599d1e04680 0x5599d1ed7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5534605640 1 -- 172.21.15.143:0/672412762 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d1ed5180 con 0x5599d1ed9e70 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5534605640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9e70 0x5599d1e00930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f552c005ec0 tx=0x7f552c008430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5531e00640 1 -- 172.21.15.143:0/672412762 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c010640 con 0x5599d1ed9e70 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5531e00640 1 -- 172.21.15.143:0/672412762 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c015070 con 0x5599d1ed9e70 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5531e00640 1 -- 172.21.15.143:0/672412762 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c010a40 con 0x5599d1ed9e70 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599d1ed5460 con 0x5599d1ed9e70 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.117+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599d1ed5a20 con 0x5599d1ed9e70 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.118+0000 7f5531e00640 1 -- 172.21.15.143:0/672412762 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f552c010be0 con 0x5599d1ed9e70 2024-05-08T10:24:41.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.119+0000 7f5531e00640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5514074cb0 0x7f5514077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.119+0000 7f5533e04640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5514074cb0 0x7f5514077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.119+0000 7f5531e00640 1 -- 172.21.15.143:0/672412762 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f552c095ea0 con 0x5599d1ed9e70 2024-05-08T10:24:41.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.119+0000 7f5536308f40 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x5599d1e4c160 0x5599d1e01380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.119+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 --> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5599d1ed3c30 con 0x5599d1e4c160 2024-05-08T10:24:41.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.119+0000 7f552bfff640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x5599d1e4c160 0x5599d1e01380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.119+0000 7f5533e04640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5514074cb0 0x7f5514077170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5524057000 tx=0x7f5524051000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f552bfff640 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x5599d1e4c160 0x5599d1e01380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.109 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f552bfff640 1 -- 172.21.15.143:0/672412762 <== osd.3 v2:172.21.15.143:6824/2042563744 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys out=19b] v0'0 uv10 ondisk = 0) ==== 164+0+19 (crc 0 0 0) 0x7f551c00d910 con 0x5599d1e4c160 2024-05-08T10:24:41.109 INFO:teuthology.orchestra.run.smithi143.stdout:alpha_head 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x5599d1e4c160 msgr2=0x5599d1e01380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x5599d1e4c160 0x5599d1e01380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5514074cb0 msgr2=0x7f5514077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f5514074cb0 0x7f5514077170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5524057000 tx=0x7f5524051000 comp rx=0 tx=0).stop 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9e70 msgr2=0x5599d1e00930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 --2- 172.21.15.143:0/672412762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5599d1ed9e70 0x5599d1e00930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f552c005ec0 tx=0x7f552c008430 comp rx=0 tx=0).stop 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5534605640 1 -- 172.21.15.143:0/672412762 reap_dead start 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 shutdown_connections 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 >> 172.21.15.143:0/672412762 conn(0x5599d1e4cf10 msgr2=0x5599d1e46ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 shutdown_connections 2024-05-08T10:24:41.111 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.120+0000 7f5536308f40 1 -- 172.21.15.143:0/672412762 wait complete. 2024-05-08T10:24:41.112 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-05-08T10:24:41.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.208+0000 7f6e86243f40 1 Processor -- start 2024-05-08T10:24:41.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.208+0000 7f6e86243f40 1 -- start start 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e86243f40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c810fed0 0x55c2c8156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e86243f40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c2c8154880 0x55c2c81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e86243f40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2c81e4d20 0x55c2c81de820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e86243f40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c2c81576a0 con 0x55c2c810fed0 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e86243f40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55c2c80b3f50 con 0x55c2c81e4d20 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e86243f40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55c2c8110820 con 0x55c2c8154880 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e83d3d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c810fed0 0x55c2c8156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e83d3d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c810fed0 0x55c2c8156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55926/0 (socket says 172.21.15.143:55926) 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e83d3d640 1 -- 172.21.15.143:0/3744713921 learned_addr learned my addr 172.21.15.143:0/3744713921 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e8353c640 1 --2- 172.21.15.143:0/3744713921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c2c8154880 0x55c2c81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e8453e640 1 --2- 172.21.15.143:0/3744713921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2c81e4d20 0x55c2c81de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e83d3d640 1 -- 172.21.15.143:0/3744713921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c2c8154880 msgr2=0x55c2c81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e83d3d640 1 --2- 172.21.15.143:0/3744713921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c2c8154880 0x55c2c81568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e83d3d640 1 -- 172.21.15.143:0/3744713921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2c81e4d20 msgr2=0x55c2c81de820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e83d3d640 1 --2- 172.21.15.143:0/3744713921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2c81e4d20 0x55c2c81de820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e83d3d640 1 -- 172.21.15.143:0/3744713921 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c81e18b0 con 0x55c2c810fed0 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e83d3d640 1 --2- 172.21.15.143:0/3744713921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c810fed0 0x55c2c8156380 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400a430 tx=0x7f6e7400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c458e70bbff105b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e8253a640 1 -- 172.21.15.143:0/3744713921 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7400b920 con 0x55c2c810fed0 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e8253a640 1 -- 172.21.15.143:0/3744713921 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7400f030 con 0x55c2c810fed0 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.209+0000 7f6e8253a640 1 -- 172.21.15.143:0/3744713921 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7400bd20 con 0x55c2c810fed0 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.210+0000 7f6e86243f40 1 -- 172.21.15.143:0/3744713921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c810fed0 msgr2=0x55c2c8156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.210+0000 7f6e86243f40 1 --2- 172.21.15.143:0/3744713921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c810fed0 0x55c2c8156380 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400a430 tx=0x7f6e7400a8f0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.210+0000 7f6e86243f40 1 -- 172.21.15.143:0/3744713921 shutdown_connections 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.210+0000 7f6e86243f40 1 --2- 172.21.15.143:0/3744713921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2c81e4d20 0x55c2c81de820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.210+0000 7f6e86243f40 1 --2- 172.21.15.143:0/3744713921 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c2c8154880 0x55c2c81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.210+0000 7f6e86243f40 1 --2- 172.21.15.143:0/3744713921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c810fed0 0x55c2c8156380 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.210+0000 7f6e86243f40 1 -- 172.21.15.143:0/3744713921 >> 172.21.15.143:0/3744713921 conn(0x55c2c810b150 msgr2=0x55c2c810ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.210+0000 7f6e86243f40 1 -- 172.21.15.143:0/3744713921 shutdown_connections 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.210+0000 7f6e86243f40 1 -- 172.21.15.143:0/3744713921 wait complete. 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e86243f40 1 Processor -- start 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e86243f40 1 -- start start 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e86243f40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2c810fed0 0x55c2c81df100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e86243f40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c8154880 0x55c2c810be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e86243f40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c2c81e4d20 0x55c2c810c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e86243f40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c2c81e01c0 con 0x55c2c8154880 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e86243f40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55c2c81dffa0 con 0x55c2c810fed0 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e86243f40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55c2c81d8ec0 con 0x55c2c81e4d20 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e8353c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c8154880 0x55c2c810be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e8353c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c8154880 0x55c2c810be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55938/0 (socket says 172.21.15.143:55938) 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.211+0000 7f6e8353c640 1 -- 172.21.15.143:0/1108518067 learned_addr learned my addr 172.21.15.143:0/1108518067 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e83d3d640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2c810fed0 0x55c2c81df100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e8453e640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c2c81e4d20 0x55c2c810c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e8353c640 1 -- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c2c81e4d20 msgr2=0x55c2c810c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e8353c640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55c2c81e4d20 0x55c2c810c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e8353c640 1 -- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2c810fed0 msgr2=0x55c2c81df100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e8353c640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2c810fed0 0x55c2c81df100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e8353c640 1 -- 172.21.15.143:0/1108518067 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c8156420 con 0x55c2c8154880 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e8353c640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c8154880 0x55c2c810be20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009f40 tx=0x7f6e780084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e81538640 1 -- 172.21.15.143:0/1108518067 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780145f0 con 0x55c2c8154880 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e81538640 1 -- 172.21.15.143:0/1108518067 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e78019070 con 0x55c2c8154880 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2c81dd000 con 0x55c2c8154880 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e81538640 1 -- 172.21.15.143:0/1108518067 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78014990 con 0x55c2c8154880 2024-05-08T10:24:41.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.212+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c81569a0 con 0x55c2c8154880 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.214+0000 7f6e81538640 1 -- 172.21.15.143:0/1108518067 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6e78014b30 con 0x55c2c8154880 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.214+0000 7f6e81538640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e70074cb0 0x7f6e70077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.214+0000 7f6e83d3d640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e70074cb0 0x7f6e70077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.214+0000 7f6e81538640 1 -- 172.21.15.143:0/1108518067 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6e78095fb0 con 0x55c2c8154880 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.214+0000 7f6e86243f40 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c2c810c360 0x55c2c81dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.214+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 --> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2c81ddf30 con 0x55c2c810c360 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.214+0000 7f6e83d3d640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e70074cb0 0x7f6e70077170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400a930 tx=0x7f6e74008000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e8453e640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c2c810c360 0x55c2c81dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e8453e640 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c2c810c360 0x55c2c81dd9f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e8453e640 1 -- 172.21.15.143:0/1108518067 <== osd.6 v2:172.21.15.163:6824/2263704478 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=19b] v0'0 uv6 ondisk = 0) ==== 154+0+19 (crc 0 0 0) 0x7f6e7c0527a0 con 0x55c2c810c360 2024-05-08T10:24:41.204 INFO:teuthology.orchestra.run.smithi143.stdout:mydir_head 2024-05-08T10:24:41.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c2c810c360 msgr2=0x55c2c81dd9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e86243f40 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x55c2c810c360 0x55c2c81dd9f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e70074cb0 msgr2=0x7f6e70077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e86243f40 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e70074cb0 0x7f6e70077170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400a930 tx=0x7f6e74008000 comp rx=0 tx=0).stop 2024-05-08T10:24:41.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c8154880 msgr2=0x55c2c810be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.205 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e86243f40 1 --2- 172.21.15.143:0/1108518067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c2c8154880 0x55c2c810be20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009f40 tx=0x7f6e780084c0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e8453e640 1 -- 172.21.15.143:0/1108518067 reap_dead start 2024-05-08T10:24:41.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 shutdown_connections 2024-05-08T10:24:41.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.215+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 >> 172.21.15.143:0/1108518067 conn(0x55c2c810b150 msgr2=0x55c2c810eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.216+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 shutdown_connections 2024-05-08T10:24:41.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.216+0000 7f6e86243f40 1 -- 172.21.15.143:0/1108518067 wait complete. 2024-05-08T10:24:41.206 DEBUG:teuthology.orchestra.run.smithi143:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-08T10:24:41.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.305+0000 7f6e747e0f40 1 Processor -- start 2024-05-08T10:24:41.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.305+0000 7f6e747e0f40 1 -- start start 2024-05-08T10:24:41.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.305+0000 7f6e747e0f40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed92c1a0 0x55d3ed9caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.305+0000 7f6e747e0f40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed9d47d0 0x55d3ed9439e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.305+0000 7f6e747e0f40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d3ed9d4bb0 0x55d3ed9d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.305+0000 7f6e747e0f40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d3ed927710 con 0x55d3ed92c1a0 2024-05-08T10:24:41.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.305+0000 7f6e747e0f40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d3ed8a4f50 con 0x55d3ed9d4bb0 2024-05-08T10:24:41.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.305+0000 7f6e747e0f40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55d3ed9458f0 con 0x55d3ed9d47d0 2024-05-08T10:24:41.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e722da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed92c1a0 0x55d3ed9caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e722da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed92c1a0 0x55d3ed9caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55952/0 (socket says 172.21.15.143:55952) 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e722da640 1 -- 172.21.15.143:0/3596904889 learned_addr learned my addr 172.21.15.143:0/3596904889 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e72adb640 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d3ed9d4bb0 0x55d3ed9d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e69ad9640 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed9d47d0 0x55d3ed9439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e722da640 1 -- 172.21.15.143:0/3596904889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed9d47d0 msgr2=0x55d3ed9439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e722da640 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed9d47d0 0x55d3ed9439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e722da640 1 -- 172.21.15.143:0/3596904889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d3ed9d4bb0 msgr2=0x55d3ed9d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e722da640 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d3ed9d4bb0 0x55d3ed9d1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e722da640 1 -- 172.21.15.143:0/3596904889 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3ed9d13a0 con 0x55d3ed92c1a0 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e69ad9640 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed9d47d0 0x55d3ed9439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e722da640 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed92c1a0 0x55d3ed9caac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e64055040 tx=0x7f6e64051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75c040f16afa29b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e712d8640 1 -- 172.21.15.143:0/3596904889 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64053800 con 0x55d3ed92c1a0 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e712d8640 1 -- 172.21.15.143:0/3596904889 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e640539c0 con 0x55d3ed92c1a0 2024-05-08T10:24:41.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.306+0000 7f6e712d8640 1 -- 172.21.15.143:0/3596904889 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64053db0 con 0x55d3ed92c1a0 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 -- 172.21.15.143:0/3596904889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed92c1a0 msgr2=0x55d3ed9caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed92c1a0 0x55d3ed9caac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e64055040 tx=0x7f6e64051000 comp rx=0 tx=0).stop 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 -- 172.21.15.143:0/3596904889 shutdown_connections 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d3ed9d4bb0 0x55d3ed9d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed9d47d0 0x55d3ed9439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 --2- 172.21.15.143:0/3596904889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed92c1a0 0x55d3ed9caac0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 -- 172.21.15.143:0/3596904889 >> 172.21.15.143:0/3596904889 conn(0x55d3ed947f10 msgr2=0x55d3ed946d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 -- 172.21.15.143:0/3596904889 shutdown_connections 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 -- 172.21.15.143:0/3596904889 wait complete. 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 Processor -- start 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.307+0000 7f6e747e0f40 1 -- start start 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e747e0f40 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed92c1a0 0x55d3ed9d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e747e0f40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed9d47d0 0x55d3eda63970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e747e0f40 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d3ed9d4bb0 0x55d3ed9279c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e747e0f40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d3ed9487f0 con 0x55d3ed9d47d0 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e747e0f40 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d3ed9485a0 con 0x55d3ed9d4bb0 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e747e0f40 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55d3ed9273f0 con 0x55d3ed92c1a0 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e69ad9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed9d47d0 0x55d3eda63970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e69ad9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed9d47d0 0x55d3eda63970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55956/0 (socket says 172.21.15.143:55956) 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e69ad9640 1 -- 172.21.15.143:0/4250430024 learned_addr learned my addr 172.21.15.143:0/4250430024 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e722da640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed92c1a0 0x55d3ed9d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e72adb640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d3ed9d4bb0 0x55d3ed9279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e69ad9640 1 -- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed92c1a0 msgr2=0x55d3ed9d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e69ad9640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55d3ed92c1a0 0x55d3ed9d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e69ad9640 1 -- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d3ed9d4bb0 msgr2=0x55d3ed9279c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e69ad9640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d3ed9d4bb0 0x55d3ed9279c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e69ad9640 1 -- 172.21.15.143:0/4250430024 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3eda64470 con 0x55d3ed9d47d0 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.308+0000 7f6e69ad9640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed9d47d0 0x55d3eda63970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c001e90 tx=0x7f6e5c00a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.297 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.309+0000 7f6e6bfff640 1 -- 172.21.15.143:0/4250430024 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c010470 con 0x55d3ed9d47d0 2024-05-08T10:24:41.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.309+0000 7f6e6bfff640 1 -- 172.21.15.143:0/4250430024 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c010610 con 0x55d3ed9d47d0 2024-05-08T10:24:41.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.309+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3ed9c7a90 con 0x55d3ed9d47d0 2024-05-08T10:24:41.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.309+0000 7f6e6bfff640 1 -- 172.21.15.143:0/4250430024 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c010a00 con 0x55d3ed9d47d0 2024-05-08T10:24:41.298 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.309+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ed9c8050 con 0x55d3ed9d47d0 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.310+0000 7f6e6bfff640 1 -- 172.21.15.143:0/4250430024 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6e5c00e040 con 0x55d3ed9d47d0 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.311+0000 7f6e6bfff640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e54074cb0 0x7f6e54077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.311+0000 7f6e6bfff640 1 -- 172.21.15.143:0/4250430024 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6e5c095f30 con 0x55d3ed9d47d0 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.311+0000 7f6e722da640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e54074cb0 0x7f6e54077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.311+0000 7f6e747e0f40 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55d3ed927f00 0x55d3eda768e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.311+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 --> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d3eda76e20 con 0x55d3ed927f00 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.311+0000 7f6e722da640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e54074cb0 0x7f6e54077170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e64064000 tx=0x7f6e64069040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.311+0000 7f6e72adb640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55d3ed927f00 0x55d3eda768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.311+0000 7f6e72adb640 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55d3ed927f00 0x55d3eda768e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e72adb640 1 -- 172.21.15.143:0/4250430024 <== osd.5 v2:172.21.15.163:6800/688232145 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (92) out=92b] v0'0 uv6 ondisk = 0) ==== 164+0+92 (crc 0 0 0) 0x7f6e6c0029d0 con 0x55d3ed927f00 2024-05-08T10:24:41.300 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55d3ed927f00 msgr2=0x55d3eda768e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x55d3ed927f00 0x55d3eda768e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e54074cb0 msgr2=0x7f6e54077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6e54074cb0 0x7f6e54077170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e64064000 tx=0x7f6e64069040 comp rx=0 tx=0).stop 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed9d47d0 msgr2=0x55d3eda63970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 --2- 172.21.15.143:0/4250430024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d3ed9d47d0 0x55d3eda63970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c001e90 tx=0x7f6e5c00a5a0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e72adb640 1 -- 172.21.15.143:0/4250430024 reap_dead start 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 shutdown_connections 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 >> 172.21.15.143:0/4250430024 conn(0x55d3ed947f10 msgr2=0x55d3ed946d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 shutdown_connections 2024-05-08T10:24:41.301 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.312+0000 7f6e747e0f40 1 -- 172.21.15.143:0/4250430024 wait complete. 2024-05-08T10:24:41.302 INFO:teuthology.orchestra.run.smithi143.stdout:Valphamydir 2024-05-08T10:24:41.302 DEBUG:teuthology.orchestra.run.smithi143:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-08T10:24:41.395 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:41.396 INFO:teuthology.orchestra.run.smithi143.stdout: "ino": 1099511627777, 2024-05-08T10:24:41.396 INFO:teuthology.orchestra.run.smithi143.stdout: "ancestors": [ 2024-05-08T10:24:41.396 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:41.396 INFO:teuthology.orchestra.run.smithi143.stdout: "dirino": 1099511627776, 2024-05-08T10:24:41.396 INFO:teuthology.orchestra.run.smithi143.stdout: "dname": "alpha", 2024-05-08T10:24:41.397 INFO:teuthology.orchestra.run.smithi143.stdout: "version": 6 2024-05-08T10:24:41.397 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-05-08T10:24:41.397 INFO:teuthology.orchestra.run.smithi143.stdout: { 2024-05-08T10:24:41.397 INFO:teuthology.orchestra.run.smithi143.stdout: "dirino": 1, 2024-05-08T10:24:41.397 INFO:teuthology.orchestra.run.smithi143.stdout: "dname": "mydir", 2024-05-08T10:24:41.398 INFO:teuthology.orchestra.run.smithi143.stdout: "version": 8 2024-05-08T10:24:41.398 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-05-08T10:24:41.398 INFO:teuthology.orchestra.run.smithi143.stdout: ], 2024-05-08T10:24:41.398 INFO:teuthology.orchestra.run.smithi143.stdout: "pool": 5, 2024-05-08T10:24:41.398 INFO:teuthology.orchestra.run.smithi143.stdout: "old_pools": [] 2024-05-08T10:24:41.398 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:41.398 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:41.401 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T10:24:41.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.517+0000 7f0945e37640 1 Processor -- start 2024-05-08T10:24:41.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.517+0000 7f0945e37640 1 -- start start 2024-05-08T10:24:41.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.518+0000 7f0945e37640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f09400d2250 0x7f09400d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.518+0000 7f0945e37640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09400b8a60 con 0x7f094015f350 2024-05-08T10:24:41.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.518+0000 7f0945e37640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09400b8d40 con 0x7f09400b8240 2024-05-08T10:24:41.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.518+0000 7f0945e37640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f09400d2c00 con 0x7f09400d2250 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.518+0000 7f093f7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f094015f350 0x7f09400bace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:35546/0 (socket says 172.21.15.143:35546) 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.518+0000 7f093f7fe640 1 -- 172.21.15.143:0/1337334890 learned_addr learned my addr 172.21.15.143:0/1337334890 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093ffff640 1 --2- 172.21.15.143:0/1337334890 >> v2:172.21.15.163:3300/0 conn(0x7f09400d2250 0x7f09400d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879285588 0 0) 0x7f09400b8a60 con 0x7f094015f350 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f092c003520 con 0x7f094015f350 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3252006679 0 0) 0x7f092c003520 con 0x7f094015f350 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 >> v2:172.21.15.163:3300/0 conn(0x7f09400d2250 msgr2=0x7f09400d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 --2- 172.21.15.143:0/1337334890 >> v2:172.21.15.163:3300/0 conn(0x7f09400d2250 0x7f09400d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 >> v1:172.21.15.163:6789/0 conn(0x7f09400b8240 legacy=0x7f09400d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09400b9020 con 0x7f094015f350 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f09300016f0 con 0x7f094015f350 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 >> v1:172.21.15.143:6789/0 conn(0x7f094015f350 legacy=0x7f09400bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f092c003aa0 0x7f092c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f092c004800 0x7f092c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f092c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f09400d2c00 con 0x7f092c005210 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f092c00c150 con 0x7f092c003aa0 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f092c00c350 con 0x7f092c004800 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093ffff640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f092c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093f7fe640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f092c003aa0 0x7f092c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f0936ffd640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f092c004800 0x7f092c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093ffff640 1 -- 172.21.15.143:0/1337334890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f092c004800 msgr2=0x7f092c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093ffff640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f092c004800 0x7f092c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093ffff640 1 -- 172.21.15.143:0/1337334890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f092c003aa0 msgr2=0x7f092c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093ffff640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f092c003aa0 0x7f092c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.519+0000 7f093ffff640 1 -- 172.21.15.143:0/1337334890 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092c003520 con 0x7f092c005210 2024-05-08T10:24:41.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.520+0000 7f093ffff640 1 -- 172.21.15.143:0/1337334890 reap_dead start 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.520+0000 7f093ffff640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f092c00b9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0938009bd0 tx=0x7f092c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab4906bfe1c63a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.520+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938009c10 con 0x7f092c005210 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.520+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0938033bd0 con 0x7f092c005210 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.520+0000 7f093effd640 1 -- 172.21.15.143:0/1337334890 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938003990 con 0x7f092c005210 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.521+0000 7f0945e37640 1 -- 172.21.15.143:0/1337334890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 msgr2=0x7f092c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.521+0000 7f0945e37640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f092c00b9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0938009bd0 tx=0x7f092c005830 comp rx=0 tx=0).stop 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.521+0000 7f0945e37640 1 -- 172.21.15.143:0/1337334890 shutdown_connections 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.521+0000 7f0945e37640 1 --2- 172.21.15.143:0/1337334890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f092c00b9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.521+0000 7f0945e37640 1 -- 172.21.15.143:0/1337334890 >> 172.21.15.143:0/1337334890 conn(0x7f0940073e70 msgr2=0x7f0940074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.521+0000 7f0945e37640 1 -- 172.21.15.143:0/1337334890 shutdown_connections 2024-05-08T10:24:41.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.521+0000 7f0945e37640 1 -- 172.21.15.143:0/1337334890 wait complete. 2024-05-08T10:24:41.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.522+0000 7f0945e37640 1 Processor -- start 2024-05-08T10:24:41.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.522+0000 7f0945e37640 1 -- start start 2024-05-08T10:24:41.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f0945e37640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f094015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f0945e37640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f094015b1b0 0x7f094015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f0945e37640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0940160cb0 0x7f0940161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f0945e37640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f094015f730 con 0x7f092c005210 2024-05-08T10:24:41.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f0945e37640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f09400b9670 con 0x7f0940160cb0 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f0945e37640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f09400b86a0 con 0x7f094015b1b0 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f094015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f094015aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55968/0 (socket says 172.21.15.143:55968) 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093f7fe640 1 -- 172.21.15.143:0/3529612260 learned_addr learned my addr 172.21.15.143:0/3529612260 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f0936ffd640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f094015b1b0 0x7f094015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093ffff640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0940160cb0 0x7f0940161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093f7fe640 1 -- 172.21.15.143:0/3529612260 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f094015b1b0 msgr2=0x7f094015b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093f7fe640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f094015b1b0 0x7f094015b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093f7fe640 1 -- 172.21.15.143:0/3529612260 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0940160cb0 msgr2=0x7f0940161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093f7fe640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0940160cb0 0x7f0940161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093f7fe640 1 -- 172.21.15.143:0/3529612260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09400c8f50 con 0x7f092c005210 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093f7fe640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f094015aa90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0930004fd0 tx=0x7f09300074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093cff9640 1 -- 172.21.15.143:0/3529612260 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093001a070 con 0x7f092c005210 2024-05-08T10:24:41.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.523+0000 7f093cff9640 1 -- 172.21.15.143:0/3529612260 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0930007740 con 0x7f092c005210 2024-05-08T10:24:41.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.524+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09400cb4b0 con 0x7f092c005210 2024-05-08T10:24:41.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.524+0000 7f093cff9640 1 -- 172.21.15.143:0/3529612260 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093000fc00 con 0x7f092c005210 2024-05-08T10:24:41.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.524+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09400cba70 con 0x7f092c005210 2024-05-08T10:24:41.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.525+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094006a4b0 con 0x7f092c005210 2024-05-08T10:24:41.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.525+0000 7f093cff9640 1 -- 172.21.15.143:0/3529612260 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f093001d070 con 0x7f092c005210 2024-05-08T10:24:41.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.526+0000 7f093cff9640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f09200762d0 0x7f0920078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.526+0000 7f093cff9640 1 -- 172.21.15.143:0/3529612260 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0930096ec0 con 0x7f092c005210 2024-05-08T10:24:41.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.526+0000 7f0936ffd640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f09200762d0 0x7f0920078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.526+0000 7f0936ffd640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f09200762d0 0x7f0920078790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0940160720 tx=0x7f0928009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.515 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.530+0000 7f093cff9640 1 -- 172.21.15.143:0/3529612260 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f09300608e0 con 0x7f092c005210 2024-05-08T10:24:41.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.750+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f09400d4d40 con 0x7f092c005210 2024-05-08T10:24:41.735 INFO:tasks.ceph.mon.a.smithi143.stderr:2024-05-08T10:24:41.750+0000 7f4664504640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T10:24:41.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.751+0000 7f093cff9640 1 -- 172.21.15.143:0/3529612260 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) ==== 161+0+0 (secure 0 0 0) 0x7f09300601e0 con 0x7f092c005210 2024-05-08T10:24:41.736 INFO:teuthology.orchestra.run.smithi143.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T10:24:41.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f09200762d0 msgr2=0x7f0920078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f09200762d0 0x7f0920078790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0940160720 tx=0x7f0928009040 comp rx=0 tx=0).stop 2024-05-08T10:24:41.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 msgr2=0x7f094015aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f094015aa90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0930004fd0 tx=0x7f09300074f0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 shutdown_connections 2024-05-08T10:24:41.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0940160cb0 0x7f0940161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f094015b1b0 0x7f094015b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f09200762d0 0x7f0920078790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 --2- 172.21.15.143:0/3529612260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f092c005210 0x7f094015aa90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 >> 172.21.15.143:0/3529612260 conn(0x7f0940073e70 msgr2=0x7f0940163090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 shutdown_connections 2024-05-08T10:24:41.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.755+0000 7f0945e37640 1 -- 172.21.15.143:0/3529612260 wait complete. 2024-05-08T10:24:41.742 INFO:tasks.ceph.mds.a.smithi143.stderr: -4124> 2024-05-08T10:24:33.009+0000 7fe23f6ca640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T10:24:41.752 DEBUG:teuthology.orchestra.run.smithi143:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event get summary 2024-05-08T10:24:41.772 INFO:tasks.ceph.mds.a.smithi143.stdout:starting mds.a at 2024-05-08T10:24:41.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.810+0000 7f6a93a88280 1 -- start start 2024-05-08T10:24:41.795 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.810+0000 7f6a93a88280 1 Processor -- start 2024-05-08T10:24:41.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.810+0000 7f6a93a88280 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b3b6cc00 0x55b5b4944000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.810+0000 7f6a93a88280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b3b6d800 0x55b5b4944580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.810+0000 7f6a93a88280 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b3b6dc00 0x55b5b4944b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.810+0000 7f6a93a88280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b5b490a180 con 0x55b5b3b6d800 2024-05-08T10:24:41.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.810+0000 7f6a93a88280 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55b5b490a300 con 0x55b5b3b6cc00 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.810+0000 7f6a93a88280 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55b5b490a480 con 0x55b5b3b6dc00 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a91a35640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b3b6d800 0x55b5b4944580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a91a35640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b3b6d800 0x55b5b4944580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56004/0 (socket says 172.21.15.143:56004) 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a91a35640 1 -- 172.21.15.143:0/1695843441 learned_addr learned my addr 172.21.15.143:0/1695843441 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a92a37640 1 --2- 172.21.15.143:0/1695843441 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b3b6dc00 0x55b5b4944b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a91a35640 1 -- 172.21.15.143:0/1695843441 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b3b6dc00 msgr2=0x55b5b4944b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a91a35640 1 --2- 172.21.15.143:0/1695843441 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b3b6dc00 0x55b5b4944b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a91a35640 1 -- 172.21.15.143:0/1695843441 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b3b6cc00 msgr2=0x55b5b4944000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a91a35640 1 --2- 172.21.15.143:0/1695843441 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b3b6cc00 0x55b5b4944000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a91a35640 1 -- 172.21.15.143:0/1695843441 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b3ba2780 con 0x55b5b3b6d800 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a91a35640 1 --2- 172.21.15.143:0/1695843441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b3b6d800 0x55b5b4944580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55b5b4997800 tx=0x55b5b490e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5abc8946b4fc68f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a8fa31640 1 -- 172.21.15.143:0/1695843441 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b5b3b92680 con 0x55b5b3b6d800 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a8fa31640 1 -- 172.21.15.143:0/1695843441 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b5b3b98a80 con 0x55b5b3b6d800 2024-05-08T10:24:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a8fa31640 1 -- 172.21.15.143:0/1695843441 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b5b3b92b60 con 0x55b5b3b6d800 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a93a88280 1 -- 172.21.15.143:0/1695843441 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b3ba23c0 con 0x55b5b3b6d800 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a93a88280 1 -- 172.21.15.143:0/1695843441 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b5b3ba3680 con 0x55b5b3b6d800 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a93a88280 4 waiting for MDS map... 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a8fa31640 1 -- 172.21.15.143:0/1695843441 <== mon.0 v2:172.21.15.143:3300/0 4 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x55b5b4a4c600 con 0x55b5b3b6d800 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a8fa31640 1 -- 172.21.15.143:0/1695843441 <== mon.0 v2:172.21.15.143:3300/0 5 ==== fsmap(e 14) ==== 2885+0+0 (secure 0 0 0) 0x55b5b3bc7180 con 0x55b5b3b6d800 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.811+0000 7f6a93a88280 4 Got MDS map 14 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.812+0000 7f6a93a88280 10 main: JournalTool::main 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.812+0000 7f6a93a88280 4 main: JournalTool: connecting to RADOS... 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.812+0000 7f6a93a88280 1 Processor -- start 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.812+0000 7f6a93a88280 1 -- start start 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a93a88280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4f400 0x55b5b4945080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a93a88280 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f800 0x55b5b4945600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a93a88280 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a93a88280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b5b490a600 con 0x55b5b4a4f400 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a93a88280 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55b5b490a780 con 0x55b5b4a4fc00 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a93a88280 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55b5b490a900 con 0x55b5b4a4f800 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92a37640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4f400 0x55b5b4945080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92a37640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4f400 0x55b5b4945080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56016/0 (socket says 172.21.15.143:56016) 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92a37640 1 -- 172.21.15.143:0/2256284436 learned_addr learned my addr 172.21.15.143:0/2256284436 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92236640 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f800 0x55b5b4945600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a91a35640 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92a37640 1 -- 172.21.15.143:0/2256284436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f800 msgr2=0x55b5b4945600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92a37640 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f800 0x55b5b4945600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92a37640 1 -- 172.21.15.143:0/2256284436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b4a4fc00 msgr2=0x55b5b4945b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92a37640 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92a37640 1 -- 172.21.15.143:0/2256284436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b3ba34a0 con 0x55b5b4a4f400 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92236640 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f800 0x55b5b4945600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a92a37640 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4f400 0x55b5b4945080 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55b5b4a605d0 tx=0x55b5b490cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419c5bd7fa335e56 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a8da2d640 1 -- 172.21.15.143:0/2256284436 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b5b3b929c0 con 0x55b5b4a4f400 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a8da2d640 1 -- 172.21.15.143:0/2256284436 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b5b3b98fc0 con 0x55b5b4a4f400 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.813+0000 7f6a8da2d640 1 -- 172.21.15.143:0/2256284436 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b5b3b92680 con 0x55b5b4a4f400 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 -- 172.21.15.143:0/2256284436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4f400 msgr2=0x55b5b4945080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4f400 0x55b5b4945080 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55b5b4a605d0 tx=0x55b5b490cae0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 -- 172.21.15.143:0/2256284436 shutdown_connections 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f800 0x55b5b4945600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 --2- 172.21.15.143:0/2256284436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4f400 0x55b5b4945080 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 -- 172.21.15.143:0/2256284436 >> 172.21.15.143:0/2256284436 conn(0x55b5b4a4f000 msgr2=0x55b5b3c67000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 -- 172.21.15.143:0/2256284436 shutdown_connections 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 -- 172.21.15.143:0/2256284436 wait complete. 2024-05-08T10:24:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 Processor -- start 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.814+0000 7f6a93a88280 1 -- start start 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a93a88280 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f400 0x55b5b4945080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a93a88280 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b4a4f800 0x55b5b4945600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a93a88280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a93a88280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b5b490bb00 con 0x55b5b4a4fc00 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a93a88280 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55b5b490b980 con 0x55b5b4a4f800 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a93a88280 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x55b5b490b800 con 0x55b5b4a4f400 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a91a35640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a91a35640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56024/0 (socket says 172.21.15.143:56024) 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a91a35640 1 -- 172.21.15.143:0/4114063895 learned_addr learned my addr 172.21.15.143:0/4114063895 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a92a37640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f400 0x55b5b4945080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a92236640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b4a4f800 0x55b5b4945600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a91a35640 1 -- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f400 msgr2=0x55b5b4945080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a91a35640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b4a4f400 0x55b5b4945080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a91a35640 1 -- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b4a4f800 msgr2=0x55b5b4945600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a91a35640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b4a4f800 0x55b5b4945600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a91a35640 1 -- 172.21.15.143:0/4114063895 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b3ba2780 con 0x55b5b4a4fc00 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a91a35640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55b5b4a619b0 tx=0x55b5b490cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a8c22a640 1 -- 172.21.15.143:0/4114063895 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b5b3b92820 con 0x55b5b4a4fc00 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a8c22a640 1 -- 172.21.15.143:0/4114063895 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b5b3b98c40 con 0x55b5b4a4fc00 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a8c22a640 1 -- 172.21.15.143:0/4114063895 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b5b3b929c0 con 0x55b5b4a4fc00 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.815+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5b3ba23c0 con 0x55b5b4a4fc00 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.816+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b3ba3680 con 0x55b5b4a4fc00 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.816+0000 7f6a93a88280 4 main: JournalTool: resolving pool 4 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.817+0000 7f6a8c22a640 1 -- 172.21.15.143:0/4114063895 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55b5b4974c00 con 0x55b5b4a4fc00 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.817+0000 7f6a8c22a640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x55b5b4ac1000 0x55b5b4946100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.817+0000 7f6a8c22a640 1 -- 172.21.15.143:0/4114063895 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x55b5b4abe600 con 0x55b5b4a4fc00 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.817+0000 7f6a93a88280 4 main: JournalTool: creating IoCtx.. 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.817+0000 7f6a93a88280 4 main: Executing for rank 0 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.817+0000 7f6a92a37640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x55b5b4ac1000 0x55b5b4946100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.817+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x55b5b4ac1400 0x55b5b4946680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.817+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 --> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5b4ac1800 con 0x55b5b4ac1400 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.817+0000 7f6a92236640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x55b5b4ac1400 0x55b5b4946680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.818+0000 7f6a92a37640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x55b5b4ac1000 0x55b5b4946100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55b5b4a605d0 tx=0x55b5b490eba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.818+0000 7f6a92236640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x55b5b4ac1400 0x55b5b4946680 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.818+0000 7f6a92236640 1 -- 172.21.15.143:0/4114063895 <== osd.1 v2:172.21.15.143:6816/671471033 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55b5b3c7a000 con 0x55b5b4ac1400 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.818+0000 7f6a93a88280 4 Pointer 400.00000000 is readable 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.818+0000 7f6a93a88280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.818+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55b5b4ac1c00 0x55b5b4946c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.818+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 --> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5b3f12000 con 0x55b5b4ac1c00 2024-05-08T10:24:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.818+0000 7f6a92a37640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55b5b4ac1c00 0x55b5b4946c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.818+0000 7f6a92a37640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55b5b4ac1c00 0x55b5b4946c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a92a37640 1 -- 172.21.15.143:0/4114063895 <== osd.3 v2:172.21.15.143:6824/2042563744 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv18 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55b5b3c7a500 con 0x55b5b4ac1c00 2024-05-08T10:24:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 10 Header 0x400000 0x402c08 0x4033f6 2024-05-08T10:24:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 10 Starting journal scan from offset 0x402c08 2024-05-08T10:24:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 --> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 11272~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5b3f12400 con 0x55b5b4ac1c00 2024-05-08T10:24:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a92a37640 1 -- 172.21.15.143:0/4114063895 <== osd.3 v2:172.21.15.143:6824/2042563744 2 ==== osd_op_reply(3 200.00000001 [read 11272~2030 out=2030b] v0'0 uv15 ondisk = 0) ==== 156+0+2030 (crc 0 0 0) 0x55b5b3c7a500 con 0x55b5b4ac1c00 2024-05-08T10:24:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 4 Read 0x7ee bytes from 200.00000001 gap=0 2024-05-08T10:24:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 10 Parsing data, 0x7ee bytes available 2024-05-08T10:24:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 10 Attempting decode at 0x402c08 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 10 Consumed 0x37c bytes 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 10 Valid entry at 0x402c08 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 10 Attempting decode at 0x402f84 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 10 Consumed 0x472 bytes 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 10 Valid entry at 0x402f84 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x55b5b3f12800 0x55b5b4947180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 --> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5b3f12c00 con 0x55b5b3f12800 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.819+0000 7f6a92236640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x55b5b3f12800 0x55b5b4947180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a92236640 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x55b5b3f12800 0x55b5b4947180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a92236640 1 -- 172.21.15.143:0/4114063895 <== osd.4 v2:172.21.15.163:6808/4191344201 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b5b3c7a000 con 0x55b5b3f12800 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 4 Reached end of journal objects 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 4 Scanned objects, 0 missing, 1 valid 2024-05-08T10:24:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 4 Events scanned, 0 gaps 2024-05-08T10:24:41.818 INFO:teuthology.orchestra.run.smithi143.stdout:Events by type: 2024-05-08T10:24:41.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 4 Found 2 valid events 2024-05-08T10:24:41.818 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 4 Selected 2 events events for processing 2024-05-08T10:24:41.819 INFO:teuthology.orchestra.run.smithi143.stdout: SUBTREEMAP: 1 2024-05-08T10:24:41.819 INFO:teuthology.orchestra.run.smithi143.stdout: UPDATE: 1 2024-05-08T10:24:41.819 INFO:teuthology.orchestra.run.smithi143.stdout:Errors: 0 2024-05-08T10:24:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 4 2 events 2024-05-08T10:24:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x55b5b4ac1400 msgr2=0x55b5b4946680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x55b5b4ac1400 0x55b5b4946680 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55b5b4ac1c00 msgr2=0x55b5b4946c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x55b5b4ac1c00 0x55b5b4946c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x55b5b3f12800 msgr2=0x55b5b4947180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x55b5b3f12800 0x55b5b4947180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a92236640 1 -- 172.21.15.143:0/4114063895 reap_dead start 2024-05-08T10:24:41.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x55b5b4ac1000 msgr2=0x55b5b4946100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x55b5b4ac1000 0x55b5b4946100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55b5b4a605d0 tx=0x55b5b490eba0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4fc00 msgr2=0x55b5b4945b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55b5b4a619b0 tx=0x55b5b490cba0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 shutdown_connections 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x55b5b4ac1000 0x55b5b4946100 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 --2- 172.21.15.143:0/4114063895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b4a4fc00 0x55b5b4945b80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.820+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 >> 172.21.15.143:0/4114063895 conn(0x55b5b4a4f000 msgr2=0x55b5b3c67000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 shutdown_connections 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 -- 172.21.15.143:0/4114063895 wait complete. 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 -- 172.21.15.143:0/1695843441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b3b6d800 msgr2=0x55b5b4944580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 --2- 172.21.15.143:0/1695843441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b3b6d800 0x55b5b4944580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55b5b4997800 tx=0x55b5b490e2a0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 -- 172.21.15.143:0/1695843441 shutdown_connections 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 --2- 172.21.15.143:0/1695843441 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55b5b3b6dc00 0x55b5b4944b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 --2- 172.21.15.143:0/1695843441 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b5b3b6d800 0x55b5b4944580 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 --2- 172.21.15.143:0/1695843441 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b5b3b6cc00 0x55b5b4944000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 -- 172.21.15.143:0/1695843441 >> 172.21.15.143:0/1695843441 conn(0x55b5b3b6d000 msgr2=0x55b5b3c66800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 -- 172.21.15.143:0/1695843441 shutdown_connections 2024-05-08T10:24:41.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.821+0000 7f6a93a88280 1 -- 172.21.15.143:0/1695843441 wait complete. 2024-05-08T10:24:41.824 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'get', 'summary'] in time 0:00:00.072400, result: Events by type: SUBTREEMAP: 1 UPDATE: 1 Errors: 0 2024-05-08T10:24:41.824 DEBUG:tasks.cephfs.test_flush:jos summary_output=Events by type: SUBTREEMAP: 1 UPDATE: 1 Errors: 0 2024-05-08T10:24:41.825 DEBUG:tasks.cephfs.test_flush:jos AssertionError 2024-05-08T10:24:41.825 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:41.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.978+0000 7f3677af8640 1 Processor -- start 2024-05-08T10:24:41.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.978+0000 7f3677af8640 1 -- start start 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3677af8640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f36701493c0 0x7f36700afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3677af8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 0x7f36700b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3677af8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36700b0560 con 0x7f36700705f0 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3677af8640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f367015fde0 con 0x7f36701493c0 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3677af8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f36700b0840 con 0x7f367006da40 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3675093640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f36700705f0 0x7f367006d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:35580/0 (socket says 172.21.15.143:35580) 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3675093640 1 -- 172.21.15.143:0/3910582846 learned_addr learned my addr 172.21.15.143:0/3910582846 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3676095640 1 --2- 172.21.15.143:0/3910582846 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 0x7f36700b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3675894640 1 --2- 172.21.15.143:0/3910582846 >> v2:172.21.15.163:3300/0 conn(0x7f36701493c0 0x7f36700afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3674892640 1 -- 172.21.15.143:0/3910582846 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610216557 0 0) 0x7f36700b0560 con 0x7f36700705f0 2024-05-08T10:24:41.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.979+0000 7f3674892640 1 -- 172.21.15.143:0/3910582846 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f365c003520 con 0x7f36700705f0 2024-05-08T10:24:41.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.980+0000 7f3676095640 1 -- 172.21.15.143:0/3910582846 >> v2:172.21.15.163:3300/0 conn(0x7f36701493c0 msgr2=0x7f36700afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:41.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.980+0000 7f3676095640 1 --2- 172.21.15.143:0/3910582846 >> v2:172.21.15.163:3300/0 conn(0x7f36701493c0 0x7f36700afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.980+0000 7f3676095640 1 -- 172.21.15.143:0/3910582846 >> v1:172.21.15.143:6789/0 conn(0x7f36700705f0 legacy=0x7f367006d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.980+0000 7f3676095640 1 -- 172.21.15.143:0/3910582846 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36700b0b20 con 0x7f367006da40 2024-05-08T10:24:41.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.980+0000 7f3676095640 1 --2- 172.21.15.143:0/3910582846 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 0x7f36700b4cb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3668009d90 tx=0x7f366802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5baf6fad46dd754c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3674892640 1 -- 172.21.15.143:0/3910582846 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668031600 con 0x7f367006da40 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3674892640 1 -- 172.21.15.143:0/3910582846 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36680317a0 con 0x7f367006da40 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3674892640 1 -- 172.21.15.143:0/3910582846 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3668031b50 con 0x7f367006da40 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3677af8640 1 -- 172.21.15.143:0/3910582846 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 msgr2=0x7f36700b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3677af8640 1 --2- 172.21.15.143:0/3910582846 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 0x7f36700b4cb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3668009d90 tx=0x7f366802a5d0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3677af8640 1 -- 172.21.15.143:0/3910582846 shutdown_connections 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3677af8640 1 --2- 172.21.15.143:0/3910582846 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 0x7f36700b4cb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3677af8640 1 --2- 172.21.15.143:0/3910582846 >> v2:172.21.15.163:3300/0 conn(0x7f36701493c0 0x7f36700afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3677af8640 1 -- 172.21.15.143:0/3910582846 >> 172.21.15.143:0/3910582846 conn(0x7f3670072ba0 msgr2=0x7f3670072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3677af8640 1 -- 172.21.15.143:0/3910582846 shutdown_connections 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.981+0000 7f3677af8640 1 -- 172.21.15.143:0/3910582846 wait complete. 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.982+0000 7f3677af8640 1 Processor -- start 2024-05-08T10:24:41.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.982+0000 7f3677af8640 1 -- start start 2024-05-08T10:24:41.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3677af8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 0x7f3670143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3677af8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700705f0 0x7f3670145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3677af8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f36701493c0 0x7f36701460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3677af8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f36700b02f0 con 0x7f36700705f0 2024-05-08T10:24:41.971 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3677af8640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f36700b0170 con 0x7f36701493c0 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3677af8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f36700b51f0 con 0x7f367006da40 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3675093640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700705f0 0x7f3670145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3675093640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700705f0 0x7f3670145b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56034/0 (socket says 172.21.15.143:56034) 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3675093640 1 -- 172.21.15.143:0/2791253544 learned_addr learned my addr 172.21.15.143:0/2791253544 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3675894640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 0x7f3670143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.983+0000 7f3676095640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f36701493c0 0x7f36701460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f3675093640 1 -- 172.21.15.143:0/2791253544 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 msgr2=0x7f3670143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f3675093640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 0x7f3670143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f3675093640 1 -- 172.21.15.143:0/2791253544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f36701493c0 msgr2=0x7f36701460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f3675093640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f36701493c0 0x7f36701460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f3675093640 1 -- 172.21.15.143:0/2791253544 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3670152fb0 con 0x7f36700705f0 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f3675093640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700705f0 0x7f3670145b60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f366000c530 tx=0x7f366000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f36667fc640 1 -- 172.21.15.143:0/2791253544 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660017070 con 0x7f36700705f0 2024-05-08T10:24:41.972 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f36667fc640 1 -- 172.21.15.143:0/2791253544 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3660005ce0 con 0x7f36700705f0 2024-05-08T10:24:41.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367013d9e0 con 0x7f36700705f0 2024-05-08T10:24:41.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f36667fc640 1 -- 172.21.15.143:0/2791253544 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660007270 con 0x7f36700705f0 2024-05-08T10:24:41.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.984+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367013dfa0 con 0x7f36700705f0 2024-05-08T10:24:41.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.985+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367006a550 con 0x7f36700705f0 2024-05-08T10:24:41.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.985+0000 7f36667fc640 1 -- 172.21.15.143:0/2791253544 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f366001a070 con 0x7f36700705f0 2024-05-08T10:24:41.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.986+0000 7f36667fc640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f36540762d0 0x7f3654078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:41.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.986+0000 7f36667fc640 1 -- 172.21.15.143:0/2791253544 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f36600968e0 con 0x7f36700705f0 2024-05-08T10:24:41.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.986+0000 7f3675894640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f36540762d0 0x7f3654078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:41.973 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.986+0000 7f3675894640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f36540762d0 0x7f3654078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f366c009a30 tx=0x7f366c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:41.975 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:41.990+0000 7f36667fc640 1 -- 172.21.15.143:0/2791253544 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f366005fb90 con 0x7f36700705f0 2024-05-08T10:24:42.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.206+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36700b23f0 con 0x7f36700705f0 2024-05-08T10:24:42.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.206+0000 7f36667fc640 1 -- 172.21.15.143:0/2791253544 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+4348 (secure 0 0 0) 0x7f3660063e90 con 0x7f36700705f0 2024-05-08T10:24:42.192 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:42.192 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2519238209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2519238209},{"type":"v1","addr":"172.21.15.163:6834","nonce":2519238209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/420423244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":420423244},{"type":"v1","addr":"172.21.15.163:6835","nonce":420423244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4794,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2143046617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2143046617},{"type":"v1","addr":"172.21.15.143:6836","nonce":2143046617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:24:28.550393+0000","modified":"2024-05-08T10:24:41.751363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-08T10:24:42.192 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 14 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f36540762d0 msgr2=0x7f3654078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f36540762d0 0x7f3654078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f366c009a30 tx=0x7f366c008040 comp rx=0 tx=0).stop 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700705f0 msgr2=0x7f3670145b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700705f0 0x7f3670145b60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f366000c530 tx=0x7f366000c9f0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 shutdown_connections 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f36701493c0 0x7f36701460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f36540762d0 0x7f3654078790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700705f0 0x7f3670145b60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 --2- 172.21.15.143:0/2791253544 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f367006da40 0x7f3670143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 >> 172.21.15.143:0/2791253544 conn(0x7f3670072ba0 msgr2=0x7f36700b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:42.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.208+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 shutdown_connections 2024-05-08T10:24:42.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.209+0000 7f3677af8640 1 -- 172.21.15.143:0/2791253544 wait complete. 2024-05-08T10:24:42.205 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T10:24:42.205 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T10:24:42.241 DEBUG:teuthology.orchestra.run.smithi163:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T10:24:42.286 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T10:24:42.286 INFO:tasks.cephfs.mount:Terminating background process 2024-05-08T10:24:42.286 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:42.286 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:42.303 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20521 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T10:24:42.303 INFO:tasks.cephfs.mount:Terminating background process 2024-05-08T10:24:42.303 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:42.303 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:42.322 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056329,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16788 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T10:24:42.322 INFO:tasks.cephfs.mount:Terminating background process 2024-05-08T10:24:42.322 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:42.322 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:42.358 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20521 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T10:24:42.358 INFO:tasks.cephfs.mount:Terminating background process 2024-05-08T10:24:42.358 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:42.358 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:42.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056329,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16788 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T10:24:42.382 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:42.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.514+0000 7fc4c3da4640 1 Processor -- start 2024-05-08T10:24:42.499 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.514+0000 7fc4c3da4640 1 -- start start 2024-05-08T10:24:42.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c3da4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc4bc15d130 0x7fc4bc0d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c3da4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc0ae180 0x7fc4bc0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c3da4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc074830 con 0x7fc4bc0af140 2024-05-08T10:24:42.501 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c3da4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc4bc0af590 con 0x7fc4bc15d130 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c3da4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc4bc073f90 con 0x7fc4bc0ae180 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c1b40640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc4bc15d130 0x7fc4bc0d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c1b40640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc4bc15d130 0x7fc4bc0d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56048/0 (socket says 172.21.15.143:56048) 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c2341640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc4bc0af140 0x7fc4bc160d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:35588/0 (socket says 172.21.15.143:35588) 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c1b40640 1 -- 172.21.15.143:0/2230178465 learned_addr learned my addr 172.21.15.143:0/2230178465 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.515+0000 7fc4c133f640 1 --2- 172.21.15.143:0/2230178465 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc0ae180 0x7fc4bc0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c1b40640 1 -- 172.21.15.143:0/2230178465 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc0ae180 msgr2=0x7fc4bc0aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c1b40640 1 --2- 172.21.15.143:0/2230178465 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc0ae180 0x7fc4bc0aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c1b40640 1 -- 172.21.15.143:0/2230178465 >> v1:172.21.15.143:6789/0 conn(0x7fc4bc0af140 legacy=0x7fc4bc160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c1b40640 1 -- 172.21.15.143:0/2230178465 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc074270 con 0x7fc4bc15d130 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c0b3e640 1 -- 172.21.15.143:0/2230178465 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660947146 0 0) 0x7fc4bc074830 con 0x7fc4bc0af140 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c133f640 1 --2- 172.21.15.143:0/2230178465 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc0ae180 0x7fc4bc0aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:42.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c1b40640 1 --2- 172.21.15.143:0/2230178465 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc15d130 0x7fc4bc0d0720 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009870 tx=0x7fc4b802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60abb259ce217da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:42.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c0b3e640 1 -- 172.21.15.143:0/2230178465 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8037070 con 0x7fc4bc15d130 2024-05-08T10:24:42.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c0b3e640 1 -- 172.21.15.143:0/2230178465 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b802ae50 con 0x7fc4bc15d130 2024-05-08T10:24:42.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.516+0000 7fc4c0b3e640 1 -- 172.21.15.143:0/2230178465 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8032860 con 0x7fc4bc15d130 2024-05-08T10:24:42.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.517+0000 7fc4c3da4640 1 -- 172.21.15.143:0/2230178465 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc15d130 msgr2=0x7fc4bc0d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.517+0000 7fc4c3da4640 1 --2- 172.21.15.143:0/2230178465 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc15d130 0x7fc4bc0d0720 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009870 tx=0x7fc4b802a300 comp rx=0 tx=0).stop 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.517+0000 7fc4c3da4640 1 -- 172.21.15.143:0/2230178465 shutdown_connections 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.517+0000 7fc4c3da4640 1 --2- 172.21.15.143:0/2230178465 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc0ae180 0x7fc4bc0aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.517+0000 7fc4c3da4640 1 --2- 172.21.15.143:0/2230178465 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc15d130 0x7fc4bc0d0720 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.517+0000 7fc4c3da4640 1 -- 172.21.15.143:0/2230178465 >> 172.21.15.143:0/2230178465 conn(0x7fc4bc06c500 msgr2=0x7fc4bc06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.517+0000 7fc4c3da4640 1 -- 172.21.15.143:0/2230178465 shutdown_connections 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.517+0000 7fc4c3da4640 1 -- 172.21.15.143:0/2230178465 wait complete. 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.518+0000 7fc4c3da4640 1 Processor -- start 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.518+0000 7fc4c3da4640 1 -- start start 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c3da4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4bc0ae180 0x7fc4bc142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c3da4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc0af140 0x7fc4bc1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c3da4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc15d130 0x7fc4bc15fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c3da4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc06fdd0 con 0x7fc4bc0af140 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c3da4640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc15d510 con 0x7fc4bc0ae180 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c3da4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc4bc06ff50 con 0x7fc4bc15d130 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c133f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc0af140 0x7fc4bc1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c133f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc0af140 0x7fc4bc1558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56056/0 (socket says 172.21.15.143:56056) 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c133f640 1 -- 172.21.15.143:0/616523433 learned_addr learned my addr 172.21.15.143:0/616523433 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c2341640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc15d130 0x7fc4bc15fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c1b40640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4bc0ae180 0x7fc4bc142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c133f640 1 -- 172.21.15.143:0/616523433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc15d130 msgr2=0x7fc4bc15fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c133f640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc15d130 0x7fc4bc15fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c133f640 1 -- 172.21.15.143:0/616523433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4bc0ae180 msgr2=0x7fc4bc142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c133f640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4bc0ae180 0x7fc4bc142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c133f640 1 -- 172.21.15.143:0/616523433 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc159b80 con 0x7fc4bc0af140 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.519+0000 7fc4c133f640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc0af140 0x7fc4bc1558f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00d800 tx=0x7fc4ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:42.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.520+0000 7fc4b27fc640 1 -- 172.21.15.143:0/616523433 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac004030 con 0x7fc4bc0af140 2024-05-08T10:24:42.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.520+0000 7fc4b27fc640 1 -- 172.21.15.143:0/616523433 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ac0041d0 con 0x7fc4bc0af140 2024-05-08T10:24:42.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.520+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc15f1a0 con 0x7fc4bc0af140 2024-05-08T10:24:42.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.520+0000 7fc4b27fc640 1 -- 172.21.15.143:0/616523433 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0096a0 con 0x7fc4bc0af140 2024-05-08T10:24:42.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.520+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4bc15f760 con 0x7fc4bc0af140 2024-05-08T10:24:42.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.521+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4bc06a550 con 0x7fc4bc0af140 2024-05-08T10:24:42.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.521+0000 7fc4b27fc640 1 -- 172.21.15.143:0/616523433 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc4ac009840 con 0x7fc4bc0af140 2024-05-08T10:24:42.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.522+0000 7fc4b27fc640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4a00762d0 0x7fc4a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.522+0000 7fc4b27fc640 1 -- 172.21.15.143:0/616523433 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7fc4ac0979a0 con 0x7fc4bc0af140 2024-05-08T10:24:42.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.522+0000 7fc4c1b40640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4a00762d0 0x7fc4a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.522+0000 7fc4c1b40640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4a00762d0 0x7fc4a0078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8034000 tx=0x7fc4b802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:42.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.526+0000 7fc4b27fc640 1 -- 172.21.15.143:0/616523433 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc4ac061240 con 0x7fc4bc0af140 2024-05-08T10:24:42.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.746+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4bc070800 con 0x7fc4bc0af140 2024-05-08T10:24:42.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.746+0000 7fc4b27fc640 1 -- 172.21.15.143:0/616523433 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+4348 (secure 0 0 0) 0x7fc4ac060b40 con 0x7fc4bc0af140 2024-05-08T10:24:42.731 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:42.732 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2519238209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2519238209},{"type":"v1","addr":"172.21.15.163:6834","nonce":2519238209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/420423244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":420423244},{"type":"v1","addr":"172.21.15.163:6835","nonce":420423244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4794,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2143046617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2143046617},{"type":"v1","addr":"172.21.15.143:6836","nonce":2143046617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:24:28.550393+0000","modified":"2024-05-08T10:24:41.751363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-08T10:24:42.732 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 14 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4a00762d0 msgr2=0x7fc4a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4a00762d0 0x7fc4a0078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8034000 tx=0x7fc4b802e000 comp rx=0 tx=0).stop 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc0af140 msgr2=0x7fc4bc1558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc0af140 0x7fc4bc1558f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00d800 tx=0x7fc4ac00dcc0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 shutdown_connections 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc4bc15d130 0x7fc4bc15fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc4a00762d0 0x7fc4a0078790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4bc0af140 0x7fc4bc1558f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 --2- 172.21.15.143:0/616523433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4bc0ae180 0x7fc4bc142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 >> 172.21.15.143:0/616523433 conn(0x7fc4bc06c500 msgr2=0x7fc4bc0ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:42.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 shutdown_connections 2024-05-08T10:24:42.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.748+0000 7fc4c3da4640 1 -- 172.21.15.143:0/616523433 wait complete. 2024-05-08T10:24:42.747 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:42.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.861+0000 7f29e3951640 1 Processor -- start 2024-05-08T10:24:42.847 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.862+0000 7f29e3951640 1 -- start start 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.862+0000 7f29e3951640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 0x7f29dc073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.862+0000 7f29e3951640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f29dc0ae180 0x7f29dc0b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.862+0000 7f29e3951640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f29dc0b46e0 0x7f29dc15fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.862+0000 7f29e3951640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc0ae700 con 0x7f29dc0b46e0 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.862+0000 7f29e3951640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc073290 con 0x7f29dc0ae180 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.862+0000 7f29e3951640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc15c400 con 0x7f29dc15c020 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e1eee640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f29dc0b46e0 0x7f29dc15fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e1eee640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f29dc0b46e0 0x7f29dc15fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56070/0 (socket says 172.21.15.143:56070) 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e1eee640 1 -- 172.21.15.143:0/4112365907 learned_addr learned my addr 172.21.15.143:0/4112365907 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e0eec640 1 --2- 172.21.15.143:0/4112365907 >> v2:172.21.15.163:3300/0 conn(0x7f29dc0ae180 0x7f29dc0b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.849 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e16ed640 1 --2- 172.21.15.143:0/4112365907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 0x7f29dc073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e1eee640 1 -- 172.21.15.143:0/4112365907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 msgr2=0x7f29dc073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e1eee640 1 --2- 172.21.15.143:0/4112365907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 0x7f29dc073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e1eee640 1 -- 172.21.15.143:0/4112365907 >> v2:172.21.15.163:3300/0 conn(0x7f29dc0ae180 msgr2=0x7f29dc0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e1eee640 1 --2- 172.21.15.143:0/4112365907 >> v2:172.21.15.163:3300/0 conn(0x7f29dc0ae180 0x7f29dc0b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e1eee640 1 -- 172.21.15.143:0/4112365907 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc072f80 con 0x7f29dc0b46e0 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.863+0000 7f29e16ed640 1 --2- 172.21.15.143:0/4112365907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 0x7f29dc073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29e1eee640 1 --2- 172.21.15.143:0/4112365907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 0x7f29dc15fb40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f29dc06f060 tx=0x7f29d402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853dea54b2d14e24 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29cffff640 1 -- 172.21.15.143:0/4112365907 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4036070 con 0x7f29dc0b46e0 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29cffff640 1 -- 172.21.15.143:0/4112365907 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d4031600 con 0x7f29dc0b46e0 2024-05-08T10:24:42.850 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29cffff640 1 -- 172.21.15.143:0/4112365907 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40319d0 con 0x7f29dc0b46e0 2024-05-08T10:24:42.853 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29e3951640 1 -- 172.21.15.143:0/4112365907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 msgr2=0x7f29dc15fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29e3951640 1 --2- 172.21.15.143:0/4112365907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 0x7f29dc15fb40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f29dc06f060 tx=0x7f29d402a570 comp rx=0 tx=0).stop 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29e3951640 1 -- 172.21.15.143:0/4112365907 shutdown_connections 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29e3951640 1 --2- 172.21.15.143:0/4112365907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 0x7f29dc15fb40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29e3951640 1 --2- 172.21.15.143:0/4112365907 >> v2:172.21.15.163:3300/0 conn(0x7f29dc0ae180 0x7f29dc0b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29e3951640 1 --2- 172.21.15.143:0/4112365907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 0x7f29dc073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.864+0000 7f29e3951640 1 -- 172.21.15.143:0/4112365907 >> 172.21.15.143:0/4112365907 conn(0x7f29dc06c500 msgr2=0x7f29dc06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.865+0000 7f29e3951640 1 -- 172.21.15.143:0/4112365907 shutdown_connections 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.865+0000 7f29e3951640 1 -- 172.21.15.143:0/4112365907 wait complete. 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.866+0000 7f29e3951640 1 Processor -- start 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.866+0000 7f29e3951640 1 -- start start 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.866+0000 7f29e3951640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29dc0ae180 0x7f29dc1f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.866+0000 7f29e3951640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 0x7f29dc1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.866+0000 7f29e3951640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 0x7f29dc1f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.866+0000 7f29e3951640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0d0860 con 0x7f29dc0b46e0 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.866+0000 7f29e3951640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc074710 con 0x7f29dc0ae180 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.866+0000 7f29e3951640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc0b4b70 con 0x7f29dc15c020 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e0eec640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 0x7f29dc1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e0eec640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 0x7f29dc1548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56078/0 (socket says 172.21.15.143:56078) 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e0eec640 1 -- 172.21.15.143:0/4243650623 learned_addr learned my addr 172.21.15.143:0/4243650623 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e16ed640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29dc0ae180 0x7f29dc1f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e1eee640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 0x7f29dc1f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e0eec640 1 -- 172.21.15.143:0/4243650623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 msgr2=0x7f29dc1f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e0eec640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 0x7f29dc1f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e0eec640 1 -- 172.21.15.143:0/4243650623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29dc0ae180 msgr2=0x7f29dc1f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:42.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e0eec640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29dc0ae180 0x7f29dc1f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:42.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e0eec640 1 -- 172.21.15.143:0/4243650623 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc1553a0 con 0x7f29dc0b46e0 2024-05-08T10:24:42.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e0eec640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 0x7f29dc1548d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e870 tx=0x7f29d800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:42.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29cdffb640 1 -- 172.21.15.143:0/4243650623 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8017070 con 0x7f29dc0b46e0 2024-05-08T10:24:42.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29cdffb640 1 -- 172.21.15.143:0/4243650623 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d800c940 con 0x7f29dc0b46e0 2024-05-08T10:24:42.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc155680 con 0x7f29dc0b46e0 2024-05-08T10:24:42.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29cdffb640 1 -- 172.21.15.143:0/4243650623 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d800cd30 con 0x7f29dc0b46e0 2024-05-08T10:24:42.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.867+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc146cb0 con 0x7f29dc0b46e0 2024-05-08T10:24:42.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.868+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc143f50 con 0x7f29dc0b46e0 2024-05-08T10:24:42.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.869+0000 7f29cdffb640 1 -- 172.21.15.143:0/4243650623 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f29d801a070 con 0x7f29dc0b46e0 2024-05-08T10:24:42.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.869+0000 7f29cdffb640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f29c0076300 0x7f29c00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:42.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.869+0000 7f29cdffb640 1 -- 172.21.15.143:0/4243650623 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f29d80977f0 con 0x7f29dc0b46e0 2024-05-08T10:24:42.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.870+0000 7f29e16ed640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f29c0076300 0x7f29c00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:42.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.870+0000 7f29e16ed640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f29c0076300 0x7f29c00787c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f29d0006e80 tx=0x7f29d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:42.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:42.874+0000 7f29cdffb640 1 -- 172.21.15.143:0/4243650623 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f29d8060aa0 con 0x7f29dc0b46e0 2024-05-08T10:24:43.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.090+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29dc155850 con 0x7f29dc0b46e0 2024-05-08T10:24:43.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.091+0000 7f29cdffb640 1 -- 172.21.15.143:0/4243650623 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5173 (secure 0 0 0) 0x7f29d8064da0 con 0x7f29dc0b46e0 2024-05-08T10:24:43.076 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:43.076 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2519238209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2519238209},{"type":"v1","addr":"172.21.15.163:6834","nonce":2519238209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/420423244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":420423244},{"type":"v1","addr":"172.21.15.163:6835","nonce":420423244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4794,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2143046617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2143046617},{"type":"v1","addr":"172.21.15.143:6836","nonce":2143046617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/843250147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":843250147},{"type":"v1","addr":"172.21.15.143:6837","nonce":843250147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:24:28.550393+0000","modified":"2024-05-08T10:24:41.751363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-08T10:24:43.076 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 15 2024-05-08T10:24:43.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f29c0076300 msgr2=0x7f29c00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f29c0076300 0x7f29c00787c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f29d0006e80 tx=0x7f29d0008040 comp rx=0 tx=0).stop 2024-05-08T10:24:43.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 msgr2=0x7f29dc1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 0x7f29dc1548d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e870 tx=0x7f29d800ed30 comp rx=0 tx=0).stop 2024-05-08T10:24:43.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 shutdown_connections 2024-05-08T10:24:43.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f29dc15c020 0x7f29dc1f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f29c0076300 0x7f29c00787c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29dc0b46e0 0x7f29dc1548d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 --2- 172.21.15.143:0/4243650623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29dc0ae180 0x7f29dc1f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 >> 172.21.15.143:0/4243650623 conn(0x7f29dc06c500 msgr2=0x7f29dc15e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:43.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 shutdown_connections 2024-05-08T10:24:43.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.093+0000 7f29e3951640 1 -- 172.21.15.143:0/4243650623 wait complete. 2024-05-08T10:24:43.089 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:43.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.204+0000 7f7e3f99d640 1 Processor -- start 2024-05-08T10:24:43.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.204+0000 7f7e3f99d640 1 -- start start 2024-05-08T10:24:43.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3f99d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e38163800 0x7f7e380d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3f99d640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7e380d3830 0x7f7e38144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3f99d640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e380d3c40 con 0x7f7e381423c0 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3f99d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7e381608b0 con 0x7f7e38163800 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3f99d640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f7e3815fca0 con 0x7f7e380d3830 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3cf38640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e38163800 0x7f7e380d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3cf38640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e38163800 0x7f7e380d32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56092/0 (socket says 172.21.15.143:56092) 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3cf38640 1 -- 172.21.15.143:0/2505742302 learned_addr learned my addr 172.21.15.143:0/2505742302 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3df3a640 1 --2- 172.21.15.143:0/2505742302 >> v2:172.21.15.163:3300/0 conn(0x7f7e380d3830 0x7f7e38144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3cf38640 1 -- 172.21.15.143:0/2505742302 >> v2:172.21.15.163:3300/0 conn(0x7f7e380d3830 msgr2=0x7f7e38144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3cf38640 1 --2- 172.21.15.143:0/2505742302 >> v2:172.21.15.163:3300/0 conn(0x7f7e380d3830 0x7f7e38144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3cf38640 1 -- 172.21.15.143:0/2505742302 >> v1:172.21.15.163:6789/0 conn(0x7f7e381423c0 legacy=0x7f7e38142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.205+0000 7f7e3cf38640 1 -- 172.21.15.143:0/2505742302 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3815ff80 con 0x7f7e38163800 2024-05-08T10:24:43.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.206+0000 7f7e3cf38640 1 --2- 172.21.15.143:0/2505742302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e38163800 0x7f7e380d32f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7e380b87e0 tx=0x7f7e2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712bd547a4d0f97f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:43.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.206+0000 7f7e2ffff640 1 -- 172.21.15.143:0/2505742302 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28037070 con 0x7f7e38163800 2024-05-08T10:24:43.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.206+0000 7f7e2ffff640 1 -- 172.21.15.143:0/2505742302 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28032440 con 0x7f7e38163800 2024-05-08T10:24:43.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.206+0000 7f7e2ffff640 1 -- 172.21.15.143:0/2505742302 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28032810 con 0x7f7e38163800 2024-05-08T10:24:43.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.207+0000 7f7e3f99d640 1 -- 172.21.15.143:0/2505742302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e38163800 msgr2=0x7f7e380d32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.193 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.207+0000 7f7e3f99d640 1 --2- 172.21.15.143:0/2505742302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e38163800 0x7f7e380d32f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7e380b87e0 tx=0x7f7e2802a270 comp rx=0 tx=0).stop 2024-05-08T10:24:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.207+0000 7f7e3f99d640 1 -- 172.21.15.143:0/2505742302 shutdown_connections 2024-05-08T10:24:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.207+0000 7f7e3f99d640 1 --2- 172.21.15.143:0/2505742302 >> v2:172.21.15.163:3300/0 conn(0x7f7e380d3830 0x7f7e38144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.207+0000 7f7e3f99d640 1 --2- 172.21.15.143:0/2505742302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e38163800 0x7f7e380d32f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.207+0000 7f7e3f99d640 1 -- 172.21.15.143:0/2505742302 >> 172.21.15.143:0/2505742302 conn(0x7f7e380682f0 msgr2=0x7f7e38068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.207+0000 7f7e3f99d640 1 -- 172.21.15.143:0/2505742302 shutdown_connections 2024-05-08T10:24:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.207+0000 7f7e3f99d640 1 -- 172.21.15.143:0/2505742302 wait complete. 2024-05-08T10:24:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.208+0000 7f7e3f99d640 1 Processor -- start 2024-05-08T10:24:43.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.208+0000 7f7e3f99d640 1 -- start start 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3f99d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e380d3830 0x7f7e38157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3f99d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e381423c0 0x7f7e380b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3f99d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e38163800 0x7f7e3806e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3f99d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7e381630a0 con 0x7f7e381423c0 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3f99d640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7e38160540 con 0x7f7e38163800 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3f99d640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f7e38163220 con 0x7f7e380d3830 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3cf38640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e381423c0 0x7f7e380b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3cf38640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e381423c0 0x7f7e380b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:56106/0 (socket says 172.21.15.143:56106) 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3cf38640 1 -- 172.21.15.143:0/1947343164 learned_addr learned my addr 172.21.15.143:0/1947343164 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3df3a640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e38163800 0x7f7e3806e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3d739640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e380d3830 0x7f7e38157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3cf38640 1 -- 172.21.15.143:0/1947343164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e380d3830 msgr2=0x7f7e38157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3cf38640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e380d3830 0x7f7e38157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3cf38640 1 -- 172.21.15.143:0/1947343164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e38163800 msgr2=0x7f7e3806e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3cf38640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e38163800 0x7f7e3806e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3cf38640 1 -- 172.21.15.143:0/1947343164 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e381f5e10 con 0x7f7e381423c0 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3df3a640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e38163800 0x7f7e3806e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3cf38640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e381423c0 0x7f7e380b3fb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7e2802a2b0 tx=0x7f7e280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e2dffb640 1 -- 172.21.15.143:0/1947343164 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28037040 con 0x7f7e381423c0 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e2dffb640 1 -- 172.21.15.143:0/1947343164 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28042070 con 0x7f7e381423c0 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e38156980 con 0x7f7e381423c0 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.209+0000 7f7e2dffb640 1 -- 172.21.15.143:0/1947343164 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28030880 con 0x7f7e381423c0 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.210+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e380b44f0 con 0x7f7e381423c0 2024-05-08T10:24:43.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.211+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e38075dc0 con 0x7f7e381423c0 2024-05-08T10:24:43.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.211+0000 7f7e2dffb640 1 -- 172.21.15.143:0/1947343164 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7e28030a20 con 0x7f7e381423c0 2024-05-08T10:24:43.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.212+0000 7f7e2dffb640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7e1c0762d0 0x7f7e1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.212+0000 7f7e2dffb640 1 -- 172.21.15.143:0/1947343164 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f7e280b7e40 con 0x7f7e381423c0 2024-05-08T10:24:43.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.212+0000 7f7e3d739640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7e1c0762d0 0x7f7e1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.199 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.212+0000 7f7e3d739640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7e1c0762d0 0x7f7e1c078790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e38156070 tx=0x7f7e34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:43.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.216+0000 7f7e2dffb640 1 -- 172.21.15.143:0/1947343164 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7e280817d0 con 0x7f7e381423c0 2024-05-08T10:24:43.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.399+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e38072da0 con 0x7f7e381423c0 2024-05-08T10:24:43.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.401+0000 7f7e2dffb640 1 -- 172.21.15.143:0/1947343164 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16836 (secure 0 0 0) 0x7f7e280810d0 con 0x7f7e381423c0 2024-05-08T10:24:43.386 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:43.386 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":32,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:24:41.751211+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:24:26.325731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:24:27.512735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3656674830":"2024-05-09T10:24:41.751187+0000","172.21.15.143:6835/3656674830":"2024-05-09T10:24:41.751187+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:43.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7e1c0762d0 msgr2=0x7f7e1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7e1c0762d0 0x7f7e1c078790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e38156070 tx=0x7f7e34009040 comp rx=0 tx=0).stop 2024-05-08T10:24:43.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e381423c0 msgr2=0x7f7e380b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e381423c0 0x7f7e380b3fb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7e2802a2b0 tx=0x7f7e280046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 shutdown_connections 2024-05-08T10:24:43.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e38163800 0x7f7e3806e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f7e1c0762d0 0x7f7e1c078790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e381423c0 0x7f7e380b3fb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 --2- 172.21.15.143:0/1947343164 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e380d3830 0x7f7e38157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 >> 172.21.15.143:0/1947343164 conn(0x7f7e380682f0 msgr2=0x7f7e38162170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:43.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 shutdown_connections 2024-05-08T10:24:43.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.403+0000 7f7e3f99d640 1 -- 172.21.15.143:0/1947343164 wait complete. 2024-05-08T10:24:43.399 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T10:24:43.399 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:43.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.515+0000 7f793df40640 1 Processor -- start 2024-05-08T10:24:43.500 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.515+0000 7f793df40640 1 -- start start 2024-05-08T10:24:43.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.515+0000 7f793df40640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f793806f090 0x7f793806f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.515+0000 7f793df40640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7938072cb0 con 0x7f79380b54d0 2024-05-08T10:24:43.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.515+0000 7f793df40640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79380b5140 con 0x7f793815b8a0 2024-05-08T10:24:43.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.515+0000 7f793df40640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f79380af910 con 0x7f793806f090 2024-05-08T10:24:43.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.515+0000 7f7936ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f79380b54d0 0x7f79380b41a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52366/0 (socket says 172.21.15.143:52366) 2024-05-08T10:24:43.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.516+0000 7f7936ffd640 1 -- 172.21.15.143:0/1827785893 learned_addr learned my addr 172.21.15.143:0/1827785893 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:43.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.516+0000 7f7937fff640 1 --2- 172.21.15.143:0/1827785893 >> v2:172.21.15.163:3300/0 conn(0x7f793806f090 0x7f793806f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.502 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.516+0000 7f79367fc640 1 -- 172.21.15.143:0/1827785893 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7089546 0 0) 0x7f7938072cb0 con 0x7f79380b54d0 2024-05-08T10:24:43.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.516+0000 7f79367fc640 1 -- 172.21.15.143:0/1827785893 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7924003520 con 0x7f79380b54d0 2024-05-08T10:24:43.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.516+0000 7f7937fff640 1 -- 172.21.15.143:0/1827785893 >> v1:172.21.15.163:6789/0 conn(0x7f793815b8a0 legacy=0x7f79380725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.516+0000 7f7937fff640 1 -- 172.21.15.143:0/1827785893 >> v1:172.21.15.143:6789/0 conn(0x7f79380b54d0 legacy=0x7f79380b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.516+0000 7f7937fff640 1 -- 172.21.15.143:0/1827785893 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79380b48b0 con 0x7f793806f090 2024-05-08T10:24:43.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f7937fff640 1 --2- 172.21.15.143:0/1827785893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793806f090 0x7f793806f4c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f793000aea0 tx=0x7f793002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3823411bc482e2fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:43.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f79367fc640 1 -- 172.21.15.143:0/1827785893 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930038070 con 0x7f793806f090 2024-05-08T10:24:43.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f79367fc640 1 -- 172.21.15.143:0/1827785893 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7930008640 con 0x7f793806f090 2024-05-08T10:24:43.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f79367fc640 1 -- 172.21.15.143:0/1827785893 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79300089f0 con 0x7f793806f090 2024-05-08T10:24:43.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f793df40640 1 -- 172.21.15.143:0/1827785893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793806f090 msgr2=0x7f793806f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f793df40640 1 --2- 172.21.15.143:0/1827785893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793806f090 0x7f793806f4c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f793000aea0 tx=0x7f793002b840 comp rx=0 tx=0).stop 2024-05-08T10:24:43.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f793df40640 1 -- 172.21.15.143:0/1827785893 shutdown_connections 2024-05-08T10:24:43.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f793df40640 1 --2- 172.21.15.143:0/1827785893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793806f090 0x7f793806f4c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f793df40640 1 -- 172.21.15.143:0/1827785893 >> 172.21.15.143:0/1827785893 conn(0x7f793806c500 msgr2=0x7f793806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f793df40640 1 -- 172.21.15.143:0/1827785893 shutdown_connections 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.517+0000 7f793df40640 1 -- 172.21.15.143:0/1827785893 wait complete. 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.519+0000 7f793df40640 1 Processor -- start 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.519+0000 7f793df40640 1 -- start start 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.519+0000 7f793df40640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f793806f090 0x7f79381e8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.519+0000 7f793df40640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79380b54d0 0x7f7938155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.519+0000 7f793df40640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793815b8a0 0x7f7938150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.519+0000 7f793df40640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f79380b4e60 con 0x7f793806f090 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.519+0000 7f793df40640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f793806fa00 con 0x7f793815b8a0 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f793df40640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f79380af5a0 con 0x7f79380b54d0 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f79377fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f793806f090 0x7f79381e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f79377fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f793806f090 0x7f79381e8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54904/0 (socket says 172.21.15.143:54904) 2024-05-08T10:24:43.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f79377fe640 1 -- 172.21.15.143:0/2255222032 learned_addr learned my addr 172.21.15.143:0/2255222032 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f7937fff640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793815b8a0 0x7f7938150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f7936ffd640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79380b54d0 0x7f7938155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f79377fe640 1 -- 172.21.15.143:0/2255222032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79380b54d0 msgr2=0x7f7938155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f79377fe640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79380b54d0 0x7f7938155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f79377fe640 1 -- 172.21.15.143:0/2255222032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793815b8a0 msgr2=0x7f7938150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f79377fe640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793815b8a0 0x7f7938150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f79377fe640 1 -- 172.21.15.143:0/2255222032 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7938154a80 con 0x7f793806f090 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f7936ffd640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79380b54d0 0x7f7938155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f79377fe640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f793806f090 0x7f79381e8410 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f792000c400 tx=0x7f792000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f792ffff640 1 -- 172.21.15.143:0/2255222032 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920017070 con 0x7f793806f090 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f792ffff640 1 -- 172.21.15.143:0/2255222032 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79200052d0 con 0x7f793806f090 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7938154d60 con 0x7f793806f090 2024-05-08T10:24:43.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f792ffff640 1 -- 172.21.15.143:0/2255222032 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920003830 con 0x7f793806f090 2024-05-08T10:24:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.520+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7938155320 con 0x7f793806f090 2024-05-08T10:24:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.521+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793806a550 con 0x7f793806f090 2024-05-08T10:24:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.522+0000 7f792ffff640 1 -- 172.21.15.143:0/2255222032 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f792001a070 con 0x7f793806f090 2024-05-08T10:24:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.522+0000 7f792ffff640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f79180762d0 0x7f7918078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.522+0000 7f792ffff640 1 -- 172.21.15.143:0/2255222032 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f7920096910 con 0x7f793806f090 2024-05-08T10:24:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.522+0000 7f7936ffd640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f79180762d0 0x7f7918078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.510 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.523+0000 7f7936ffd640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f79180762d0 0x7f7918078790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7928007fd0 tx=0x7f7928009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:43.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.527+0000 7f792ffff640 1 -- 172.21.15.143:0/2255222032 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f792005fc50 con 0x7f793806f090 2024-05-08T10:24:43.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.748+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79380b6420 con 0x7f793806f090 2024-05-08T10:24:43.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.749+0000 7f792ffff640 1 -- 172.21.15.143:0/2255222032 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5173 (secure 0 0 0) 0x7f7920068290 con 0x7f793806f090 2024-05-08T10:24:43.734 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:43.734 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2519238209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2519238209},{"type":"v1","addr":"172.21.15.163:6834","nonce":2519238209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/420423244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":420423244},{"type":"v1","addr":"172.21.15.163:6835","nonce":420423244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4794,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2143046617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2143046617},{"type":"v1","addr":"172.21.15.143:6836","nonce":2143046617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/843250147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":843250147},{"type":"v1","addr":"172.21.15.143:6837","nonce":843250147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:24:28.550393+0000","modified":"2024-05-08T10:24:41.751363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-08T10:24:43.734 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 15 2024-05-08T10:24:43.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f79180762d0 msgr2=0x7f7918078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f79180762d0 0x7f7918078790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7928007fd0 tx=0x7f7928009040 comp rx=0 tx=0).stop 2024-05-08T10:24:43.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f793806f090 msgr2=0x7f79381e8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f793806f090 0x7f79381e8410 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f792000c400 tx=0x7f792000c8c0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 shutdown_connections 2024-05-08T10:24:43.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793815b8a0 0x7f7938150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79380b54d0 0x7f7938155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f79180762d0 0x7f7918078790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 --2- 172.21.15.143:0/2255222032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f793806f090 0x7f79381e8410 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 >> 172.21.15.143:0/2255222032 conn(0x7f793806c500 msgr2=0x7f7938072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:43.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 shutdown_connections 2024-05-08T10:24:43.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.751+0000 7f793df40640 1 -- 172.21.15.143:0/2255222032 wait complete. 2024-05-08T10:24:43.747 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:24:43.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.862+0000 7fce9d7c8640 1 Processor -- start 2024-05-08T10:24:43.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.862+0000 7fce9d7c8640 1 -- start start 2024-05-08T10:24:43.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce9d7c8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce98162900 0x7fce98073f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce9d7c8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce980b74f0 con 0x7fce980aef80 2024-05-08T10:24:43.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce9d7c8640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce98162ce0 con 0x7fce980d2170 2024-05-08T10:24:43.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce9d7c8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fce980b50b0 con 0x7fce98162900 2024-05-08T10:24:43.854 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce96ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce98162900 0x7fce98073f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce8e7fc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fce980aef80 0x7fce980b6ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52380/0 (socket says 172.21.15.143:52380) 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce8e7fc640 1 -- 172.21.15.143:0/3730801631 learned_addr learned my addr 172.21.15.143:0/3730801631 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce96ffd640 1 --2- 172.21.15.143:0/3730801631 >> v2:172.21.15.143:3300/0 conn(0x7fce98162900 0x7fce98073f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54920/0 (socket says 172.21.15.143:54920) 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce96ffd640 1 -- 172.21.15.143:0/3730801631 >> v1:172.21.15.163:6789/0 conn(0x7fce980d2170 legacy=0x7fce980d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce96ffd640 1 -- 172.21.15.143:0/3730801631 >> v1:172.21.15.143:6789/0 conn(0x7fce980aef80 legacy=0x7fce980b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce96ffd640 1 -- 172.21.15.143:0/3730801631 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce980b5390 con 0x7fce98162900 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.863+0000 7fce967fc640 1 -- 172.21.15.143:0/3730801631 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846036953 0 0) 0x7fce980b74f0 con 0x7fce980aef80 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.864+0000 7fce96ffd640 1 --2- 172.21.15.143:0/3730801631 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 0x7fce98073f70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fce880097a0 tx=0x7fce8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f006012276f296 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.864+0000 7fce967fc640 1 -- 172.21.15.143:0/3730801631 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88037070 con 0x7fce98162900 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.864+0000 7fce967fc640 1 -- 172.21.15.143:0/3730801631 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce88032440 con 0x7fce98162900 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.864+0000 7fce967fc640 1 -- 172.21.15.143:0/3730801631 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88032810 con 0x7fce98162900 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.865+0000 7fce9d7c8640 1 -- 172.21.15.143:0/3730801631 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 msgr2=0x7fce98073f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.855 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.865+0000 7fce9d7c8640 1 --2- 172.21.15.143:0/3730801631 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 0x7fce98073f70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fce880097a0 tx=0x7fce8802a1a0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.865+0000 7fce9d7c8640 1 -- 172.21.15.143:0/3730801631 shutdown_connections 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.865+0000 7fce9d7c8640 1 --2- 172.21.15.143:0/3730801631 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 0x7fce98073f70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.865+0000 7fce9d7c8640 1 -- 172.21.15.143:0/3730801631 >> 172.21.15.143:0/3730801631 conn(0x7fce9806d610 msgr2=0x7fce9806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.865+0000 7fce9d7c8640 1 -- 172.21.15.143:0/3730801631 shutdown_connections 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.865+0000 7fce9d7c8640 1 -- 172.21.15.143:0/3730801631 wait complete. 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.866+0000 7fce9d7c8640 1 Processor -- start 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.866+0000 7fce9d7c8640 1 -- start start 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce9d7c8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fce980aef80 0x7fce9813cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce9d7c8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce980d2170 0x7fce9813a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce9d7c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 0x7fce9813b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce9d7c8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fce98169f70 con 0x7fce98162900 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce9d7c8640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fce9806f4d0 con 0x7fce980d2170 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce9d7c8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fce9816a0f0 con 0x7fce980aef80 2024-05-08T10:24:43.856 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce977fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 0x7fce9813b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce977fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 0x7fce9813b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54928/0 (socket says 172.21.15.143:54928) 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce977fe640 1 -- 172.21.15.143:0/2417748590 learned_addr learned my addr 172.21.15.143:0/2417748590 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce8e7fc640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce980d2170 0x7fce9813a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce96ffd640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fce980aef80 0x7fce9813cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce977fe640 1 -- 172.21.15.143:0/2417748590 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fce980aef80 msgr2=0x7fce9813cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce977fe640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fce980aef80 0x7fce9813cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce977fe640 1 -- 172.21.15.143:0/2417748590 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce980d2170 msgr2=0x7fce9813a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce977fe640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce980d2170 0x7fce9813a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.867+0000 7fce977fe640 1 -- 172.21.15.143:0/2417748590 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9813adf0 con 0x7fce98162900 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.868+0000 7fce977fe640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 0x7fce9813b0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c7d0 tx=0x7fce9000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.868+0000 7fce8ffff640 1 -- 172.21.15.143:0/2417748590 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90003b70 con 0x7fce98162900 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.868+0000 7fce8ffff640 1 -- 172.21.15.143:0/2417748590 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce90003d10 con 0x7fce98162900 2024-05-08T10:24:43.857 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.868+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9813ba60 con 0x7fce98162900 2024-05-08T10:24:43.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.868+0000 7fce8ffff640 1 -- 172.21.15.143:0/2417748590 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9000aa70 con 0x7fce98162900 2024-05-08T10:24:43.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.868+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9813c020 con 0x7fce98162900 2024-05-08T10:24:43.858 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.869+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9806a550 con 0x7fce98162900 2024-05-08T10:24:43.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.869+0000 7fce8ffff640 1 -- 172.21.15.143:0/2417748590 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce9000ac10 con 0x7fce98162900 2024-05-08T10:24:43.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.870+0000 7fce8ffff640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fce780762d0 0x7fce78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:43.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.870+0000 7fce96ffd640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fce780762d0 0x7fce78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:43.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.870+0000 7fce8ffff640 1 -- 172.21.15.143:0/2417748590 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7fce900973c0 con 0x7fce98162900 2024-05-08T10:24:43.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.870+0000 7fce96ffd640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fce780762d0 0x7fce78078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce88034000 tx=0x7fce8802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:43.859 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:43.874+0000 7fce8ffff640 1 -- 172.21.15.143:0/2417748590 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce98162ce0 con 0x7fce98162900 2024-05-08T10:24:44.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.094+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce9815f230 con 0x7fce98162900 2024-05-08T10:24:44.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.095+0000 7fce8ffff640 1 -- 172.21.15.143:0/2417748590 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5173 (secure 0 0 0) 0x7fce90060700 con 0x7fce98162900 2024-05-08T10:24:44.080 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:44.080 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2519238209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2519238209},{"type":"v1","addr":"172.21.15.163:6834","nonce":2519238209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/420423244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":420423244},{"type":"v1","addr":"172.21.15.163:6835","nonce":420423244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4794,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2143046617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2143046617},{"type":"v1","addr":"172.21.15.143:6836","nonce":2143046617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/843250147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":843250147},{"type":"v1","addr":"172.21.15.143:6837","nonce":843250147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:24:28.550393+0000","modified":"2024-05-08T10:24:41.751363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-08T10:24:44.080 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 15 2024-05-08T10:24:44.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fce780762d0 msgr2=0x7fce78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fce780762d0 0x7fce78078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce88034000 tx=0x7fce8802e000 comp rx=0 tx=0).stop 2024-05-08T10:24:44.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 msgr2=0x7fce9813b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 0x7fce9813b0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c7d0 tx=0x7fce9000cc90 comp rx=0 tx=0).stop 2024-05-08T10:24:44.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 shutdown_connections 2024-05-08T10:24:44.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fce780762d0 0x7fce78078790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce98162900 0x7fce9813b0f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce980d2170 0x7fce9813a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 --2- 172.21.15.143:0/2417748590 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fce980aef80 0x7fce9813cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 >> 172.21.15.143:0/2417748590 conn(0x7fce9806d610 msgr2=0x7fce981541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:44.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 shutdown_connections 2024-05-08T10:24:44.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.097+0000 7fce9d7c8640 1 -- 172.21.15.143:0/2417748590 wait complete. 2024-05-08T10:24:44.093 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:44.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.209+0000 7fc7c7f78640 1 Processor -- start 2024-05-08T10:24:44.194 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.209+0000 7fc7c7f78640 1 -- start start 2024-05-08T10:24:44.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c7f78640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc7c015f760 0x7fc7c00b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c7f78640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c00d0070 con 0x7fc7c00cfc10 2024-05-08T10:24:44.195 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c7f78640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c00d36f0 con 0x7fc7c00d0a00 2024-05-08T10:24:44.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c7f78640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c015fb40 con 0x7fc7c015f760 2024-05-08T10:24:44.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c5513640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc7c00cfc10 0x7fc7c00d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52382/0 (socket says 172.21.15.143:52382) 2024-05-08T10:24:44.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c5513640 1 -- 172.21.15.143:0/2533626084 learned_addr learned my addr 172.21.15.143:0/2533626084 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:44.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c5d14640 1 --2- 172.21.15.143:0/2533626084 >> v2:172.21.15.163:3300/0 conn(0x7fc7c015f760 0x7fc7c00b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c4d12640 1 -- 172.21.15.143:0/2533626084 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969994306 0 0) 0x7fc7b0001110 con 0x7fc7c00cfc10 2024-05-08T10:24:44.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c5d14640 1 -- 172.21.15.143:0/2533626084 >> v1:172.21.15.163:6789/0 conn(0x7fc7c00d0a00 legacy=0x7fc7c00b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c5d14640 1 -- 172.21.15.143:0/2533626084 >> v1:172.21.15.143:6789/0 conn(0x7fc7c00cfc10 legacy=0x7fc7c00d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.196 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.210+0000 7fc7c5d14640 1 -- 172.21.15.143:0/2533626084 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c00d39d0 con 0x7fc7c015f760 2024-05-08T10:24:44.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.211+0000 7fc7c5d14640 1 --2- 172.21.15.143:0/2533626084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 0x7fc7c00b4770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0097a0 tx=0x7fc7bc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f47f1bfbb81312e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:44.197 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.211+0000 7fc7c4d12640 1 -- 172.21.15.143:0/2533626084 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc037070 con 0x7fc7c015f760 2024-05-08T10:24:44.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.211+0000 7fc7c4d12640 1 -- 172.21.15.143:0/2533626084 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc032440 con 0x7fc7c015f760 2024-05-08T10:24:44.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.211+0000 7fc7c4d12640 1 -- 172.21.15.143:0/2533626084 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc032810 con 0x7fc7c015f760 2024-05-08T10:24:44.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.212+0000 7fc7c7f78640 1 -- 172.21.15.143:0/2533626084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 msgr2=0x7fc7c00b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.212+0000 7fc7c7f78640 1 --2- 172.21.15.143:0/2533626084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 0x7fc7c00b4770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0097a0 tx=0x7fc7bc02a1a0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.212+0000 7fc7c7f78640 1 -- 172.21.15.143:0/2533626084 shutdown_connections 2024-05-08T10:24:44.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.212+0000 7fc7c7f78640 1 --2- 172.21.15.143:0/2533626084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 0x7fc7c00b4770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.212+0000 7fc7c7f78640 1 -- 172.21.15.143:0/2533626084 >> 172.21.15.143:0/2533626084 conn(0x7fc7c00740e0 msgr2=0x7fc7c006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:44.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.212+0000 7fc7c7f78640 1 -- 172.21.15.143:0/2533626084 shutdown_connections 2024-05-08T10:24:44.198 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.212+0000 7fc7c7f78640 1 -- 172.21.15.143:0/2533626084 wait complete. 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.213+0000 7fc7c7f78640 1 Processor -- start 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.213+0000 7fc7c7f78640 1 -- start start 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c7f78640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c00cfc10 0x7fc7c00c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c7f78640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7c00d0a00 0x7fc7c0148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c7f78640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 0x7fc7c015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c7f78640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c00d4270 con 0x7fc7c00cfc10 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c7f78640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c00d3f90 con 0x7fc7c015f760 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c7f78640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c00d4790 con 0x7fc7c00d0a00 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c5d14640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c00cfc10 0x7fc7c00c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c5d14640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c00cfc10 0x7fc7c00c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54936/0 (socket says 172.21.15.143:54936) 2024-05-08T10:24:44.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c5d14640 1 -- 172.21.15.143:0/4271191193 learned_addr learned my addr 172.21.15.143:0/4271191193 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c6515640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 0x7fc7c015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.214+0000 7fc7c5513640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7c00d0a00 0x7fc7c0148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7c5d14640 1 -- 172.21.15.143:0/4271191193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7c00d0a00 msgr2=0x7fc7c0148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7c5d14640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7c00d0a00 0x7fc7c0148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7c5d14640 1 -- 172.21.15.143:0/4271191193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 msgr2=0x7fc7c015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7c5d14640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 0x7fc7c015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7c5d14640 1 -- 172.21.15.143:0/4271191193 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c0159bf0 con 0x7fc7c00cfc10 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7c6515640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 0x7fc7c015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7c5d14640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c00cfc10 0x7fc7c00c8020 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0097a0 tx=0x7fc7bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7b67fc640 1 -- 172.21.15.143:0/4271191193 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc037040 con 0x7fc7c00cfc10 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7b67fc640 1 -- 172.21.15.143:0/4271191193 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc004250 con 0x7fc7c00cfc10 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7b67fc640 1 -- 172.21.15.143:0/4271191193 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc032e40 con 0x7fc7c00cfc10 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c0159e90 con 0x7fc7c00cfc10 2024-05-08T10:24:44.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.215+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c015a450 con 0x7fc7c00cfc10 2024-05-08T10:24:44.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.216+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c006a550 con 0x7fc7c00cfc10 2024-05-08T10:24:44.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.217+0000 7fc7b67fc640 1 -- 172.21.15.143:0/4271191193 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc7bc0306f0 con 0x7fc7c00cfc10 2024-05-08T10:24:44.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.217+0000 7fc7b67fc640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc7a40762d0 0x7fc7a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.204 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.217+0000 7fc7c5513640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc7a40762d0 0x7fc7a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.204 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.217+0000 7fc7b67fc640 1 -- 172.21.15.143:0/4271191193 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7fc7bc0b87a0 con 0x7fc7c00cfc10 2024-05-08T10:24:44.204 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.218+0000 7fc7c5513640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc7a40762d0 0x7fc7a4078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc7c015b930 tx=0x7fc7b0007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:44.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.221+0000 7fc7b67fc640 1 -- 172.21.15.143:0/4271191193 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc7bc081a50 con 0x7fc7c00cfc10 2024-05-08T10:24:44.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.404+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7c00d1320 con 0x7fc7c00cfc10 2024-05-08T10:24:44.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.405+0000 7fc7b67fc640 1 -- 172.21.15.143:0/4271191193 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16836 (secure 0 0 0) 0x7fc7bc08a090 con 0x7fc7c00cfc10 2024-05-08T10:24:44.390 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:44.391 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":32,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:24:41.751211+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:24:26.325731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:24:27.512735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3656674830":"2024-05-09T10:24:41.751187+0000","172.21.15.143:6835/3656674830":"2024-05-09T10:24:41.751187+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:44.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc7a40762d0 msgr2=0x7fc7a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc7a40762d0 0x7fc7a4078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc7c015b930 tx=0x7fc7b0007e40 comp rx=0 tx=0).stop 2024-05-08T10:24:44.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c00cfc10 msgr2=0x7fc7c00c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.393 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c00cfc10 0x7fc7c00c8020 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0097a0 tx=0x7fc7bc0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 shutdown_connections 2024-05-08T10:24:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7c015f760 0x7fc7c015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc7c00d0a00 0x7fc7c0148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc7a40762d0 0x7fc7a4078790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 --2- 172.21.15.143:0/4271191193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7c00cfc10 0x7fc7c00c8020 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 >> 172.21.15.143:0/4271191193 conn(0x7fc7c00740e0 msgr2=0x7fc7c00c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:44.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 shutdown_connections 2024-05-08T10:24:44.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.407+0000 7fc7c7f78640 1 -- 172.21.15.143:0/4271191193 wait complete. 2024-05-08T10:24:44.403 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T10:24:44.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.519+0000 7f284adc8640 1 Processor -- start 2024-05-08T10:24:44.504 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.519+0000 7f284adc8640 1 -- start start 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f284adc8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 0x7f28440b7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f284adc8640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f28440b0770 0x7f28440b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f284adc8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28440b74c0 con 0x7f284415f450 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f284adc8640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f28440af800 con 0x7f28440b0770 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f284adc8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f28440b62d0 con 0x7f28440af290 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f2848b64640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f284415f450 0x7f28440b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52388/0 (socket says 172.21.15.143:52388) 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f2848b64640 1 -- 172.21.15.143:0/978178380 learned_addr learned my addr 172.21.15.143:0/978178380 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f2849365640 1 --2- 172.21.15.143:0/978178380 >> v2:172.21.15.163:3300/0 conn(0x7f28440b0770 0x7f28440b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f2843fff640 1 --2- 172.21.15.143:0/978178380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 0x7f28440b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f28437fe640 1 -- 172.21.15.143:0/978178380 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3606599861 0 0) 0x7f28440b74c0 con 0x7f284415f450 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f28437fe640 1 -- 172.21.15.143:0/978178380 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2834003520 con 0x7f284415f450 2024-05-08T10:24:44.506 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f2849365640 1 -- 172.21.15.143:0/978178380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 msgr2=0x7f28440b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:44.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f2849365640 1 --2- 172.21.15.143:0/978178380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 0x7f28440b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f2849365640 1 -- 172.21.15.143:0/978178380 >> v1:172.21.15.143:6789/0 conn(0x7f284415f450 legacy=0x7f28440b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f2849365640 1 -- 172.21.15.143:0/978178380 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28440b65b0 con 0x7f28440b0770 2024-05-08T10:24:44.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.520+0000 7f2843fff640 1 --2- 172.21.15.143:0/978178380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 0x7f28440b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:44.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.521+0000 7f2849365640 1 --2- 172.21.15.143:0/978178380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28440b0770 0x7f28440b0c00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f283c009d90 tx=0x7f283c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb85dde63541e5ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.521+0000 7f28437fe640 1 -- 172.21.15.143:0/978178380 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c007740 con 0x7f28440b0770 2024-05-08T10:24:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.521+0000 7f28437fe640 1 -- 172.21.15.143:0/978178380 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c0078e0 con 0x7f28440b0770 2024-05-08T10:24:44.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.521+0000 7f28437fe640 1 -- 172.21.15.143:0/978178380 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c007cb0 con 0x7f28440b0770 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.522+0000 7f284adc8640 1 -- 172.21.15.143:0/978178380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28440b0770 msgr2=0x7f28440b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.522+0000 7f284adc8640 1 --2- 172.21.15.143:0/978178380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28440b0770 0x7f28440b0c00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f283c009d90 tx=0x7f283c02a660 comp rx=0 tx=0).stop 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.522+0000 7f284adc8640 1 -- 172.21.15.143:0/978178380 shutdown_connections 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.522+0000 7f284adc8640 1 --2- 172.21.15.143:0/978178380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28440b0770 0x7f28440b0c00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.522+0000 7f284adc8640 1 --2- 172.21.15.143:0/978178380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 0x7f28440b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.522+0000 7f284adc8640 1 -- 172.21.15.143:0/978178380 >> 172.21.15.143:0/978178380 conn(0x7f2844073b40 msgr2=0x7f284406c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.522+0000 7f284adc8640 1 -- 172.21.15.143:0/978178380 shutdown_connections 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.522+0000 7f284adc8640 1 -- 172.21.15.143:0/978178380 wait complete. 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.523+0000 7f284adc8640 1 Processor -- start 2024-05-08T10:24:44.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.523+0000 7f284adc8640 1 -- start start 2024-05-08T10:24:44.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f284adc8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 0x7f2844152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f284adc8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28440b0770 0x7f28441634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f284adc8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f284415f450 0x7f2844148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f284adc8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f28440b6070 con 0x7f284415f450 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f284adc8640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f28440b5ef0 con 0x7f28440b0770 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f284adc8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f28440b03d0 con 0x7f28440af290 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2849365640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f284415f450 0x7f2844148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2849365640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f284415f450 0x7f2844148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54952/0 (socket says 172.21.15.143:54952) 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2849365640 1 -- 172.21.15.143:0/490722198 learned_addr learned my addr 172.21.15.143:0/490722198 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2849365640 1 -- 172.21.15.143:0/490722198 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 msgr2=0x7f2844152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2848b64640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 0x7f2844152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2843fff640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28440b0770 0x7f28441634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2849365640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 0x7f2844152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2849365640 1 -- 172.21.15.143:0/490722198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28440b0770 msgr2=0x7f28441634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2849365640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28440b0770 0x7f28441634e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2849365640 1 -- 172.21.15.143:0/490722198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2844148680 con 0x7f284415f450 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.524+0000 7f2849365640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f284415f450 0x7f2844148140 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f283c02ac50 tx=0x7f283c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.525+0000 7f28417fa640 1 -- 172.21.15.143:0/490722198 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c040070 con 0x7f284415f450 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.525+0000 7f28417fa640 1 -- 172.21.15.143:0/490722198 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c031bc0 con 0x7f284415f450 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.525+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2844163c70 con 0x7f284415f450 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.525+0000 7f28417fa640 1 -- 172.21.15.143:0/490722198 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c009450 con 0x7f284415f450 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.525+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f284415fb10 con 0x7f284415f450 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.526+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f284406a4b0 con 0x7f284415f450 2024-05-08T10:24:44.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.526+0000 7f28417fa640 1 -- 172.21.15.143:0/490722198 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f283c039040 con 0x7f284415f450 2024-05-08T10:24:44.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.527+0000 7f28417fa640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28280762d0 0x7f2828078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:44.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.527+0000 7f28417fa640 1 -- 172.21.15.143:0/490722198 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f283c0b8d40 con 0x7f284415f450 2024-05-08T10:24:44.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.527+0000 7f2848b64640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28280762d0 0x7f2828078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:44.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.527+0000 7f2848b64640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28280762d0 0x7f2828078790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2838001220 tx=0x7f2838009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:44.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.531+0000 7f28417fa640 1 -- 172.21.15.143:0/490722198 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f283c0826d0 con 0x7f284415f450 2024-05-08T10:24:44.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:44.751+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f28440aff40 con 0x7f284415f450 2024-05-08T10:24:45.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.613+0000 7f28417fa640 1 -- 172.21.15.143:0/490722198 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7f283c081fd0 con 0x7f284415f450 2024-05-08T10:24:45.599 INFO:teuthology.orchestra.run.smithi143.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T10:24:45.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28280762d0 msgr2=0x7f2828078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:45.601 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28280762d0 0x7f2828078790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2838001220 tx=0x7f2838009040 comp rx=0 tx=0).stop 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f284415f450 msgr2=0x7f2844148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f284415f450 0x7f2844148140 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f283c02ac50 tx=0x7f283c004a40 comp rx=0 tx=0).stop 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 shutdown_connections 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f28280762d0 0x7f2828078790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f284415f450 0x7f2844148140 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28440b0770 0x7f28441634e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 --2- 172.21.15.143:0/490722198 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f28440af290 0x7f2844152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 >> 172.21.15.143:0/490722198 conn(0x7f2844073b40 msgr2=0x7f28440b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 shutdown_connections 2024-05-08T10:24:45.602 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.616+0000 7f284adc8640 1 -- 172.21.15.143:0/490722198 wait complete. 2024-05-08T10:24:45.616 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T10:24:45.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.738+0000 7f021536a640 1 Processor -- start 2024-05-08T10:24:45.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.738+0000 7f021536a640 1 -- start start 2024-05-08T10:24:45.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f021536a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f021015f5a0 0x7f02100d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f021536a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0210163250 0x7f02101636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f021536a640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0210163f00 con 0x7f02100d19c0 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f021536a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f02100cfe20 con 0x7f0210163250 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f021536a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f02100d0100 con 0x7f021015f5a0 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f020f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0210163250 0x7f02101636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f020f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0210163250 0x7f02101636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54960/0 (socket says 172.21.15.143:54960) 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f020f7fe640 1 -- 172.21.15.143:0/1401971494 learned_addr learned my addr 172.21.15.143:0/1401971494 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f020f7fe640 1 -- 172.21.15.143:0/1401971494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f021015f5a0 msgr2=0x7f02100d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f020f7fe640 1 --2- 172.21.15.143:0/1401971494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f021015f5a0 0x7f02100d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f020f7fe640 1 -- 172.21.15.143:0/1401971494 >> v1:172.21.15.163:6789/0 conn(0x7f02100d19c0 legacy=0x7f02100d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:45.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.739+0000 7f020f7fe640 1 -- 172.21.15.143:0/1401971494 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02100d03e0 con 0x7f0210163250 2024-05-08T10:24:45.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.740+0000 7f020f7fe640 1 --2- 172.21.15.143:0/1401971494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0210163250 0x7f02101636a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0208009e50 tx=0x7f020802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d5837b0801b2a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:45.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.740+0000 7f020e7fc640 1 -- 172.21.15.143:0/1401971494 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208036070 con 0x7f0210163250 2024-05-08T10:24:45.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.740+0000 7f020e7fc640 1 -- 172.21.15.143:0/1401971494 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0208031600 con 0x7f0210163250 2024-05-08T10:24:45.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.740+0000 7f020e7fc640 1 -- 172.21.15.143:0/1401971494 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02080319d0 con 0x7f0210163250 2024-05-08T10:24:45.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.741+0000 7f021536a640 1 -- 172.21.15.143:0/1401971494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0210163250 msgr2=0x7f02101636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:45.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.741+0000 7f021536a640 1 --2- 172.21.15.143:0/1401971494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0210163250 0x7f02101636a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0208009e50 tx=0x7f020802a680 comp rx=0 tx=0).stop 2024-05-08T10:24:45.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.741+0000 7f021536a640 1 -- 172.21.15.143:0/1401971494 shutdown_connections 2024-05-08T10:24:45.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.741+0000 7f021536a640 1 --2- 172.21.15.143:0/1401971494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0210163250 0x7f02101636a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:45.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.741+0000 7f021536a640 1 --2- 172.21.15.143:0/1401971494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f021015f5a0 0x7f02100d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:45.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.741+0000 7f021536a640 1 -- 172.21.15.143:0/1401971494 >> 172.21.15.143:0/1401971494 conn(0x7f0210074080 msgr2=0x7f021006d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:45.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.741+0000 7f021536a640 1 -- 172.21.15.143:0/1401971494 shutdown_connections 2024-05-08T10:24:45.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.741+0000 7f021536a640 1 -- 172.21.15.143:0/1401971494 wait complete. 2024-05-08T10:24:45.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.742+0000 7f021536a640 1 Processor -- start 2024-05-08T10:24:45.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.742+0000 7f021536a640 1 -- start start 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f021536a640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02100d19c0 0x7f0210158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f021536a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f021015f5a0 0x7f021015b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f021536a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0210163250 0x7f02100cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f021536a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f021015fb00 con 0x7f021015f5a0 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f021536a640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f021015f980 con 0x7f02100d19c0 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f021536a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f02100d38e0 con 0x7f0210163250 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f02067fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f021015f5a0 0x7f021015b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f02067fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f021015f5a0 0x7f021015b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54966/0 (socket says 172.21.15.143:54966) 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f02067fc640 1 -- 172.21.15.143:0/409503378 learned_addr learned my addr 172.21.15.143:0/409503378 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:45.730 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f020f7fe640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0210163250 0x7f02100cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f020effd640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02100d19c0 0x7f0210158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f02067fc640 1 -- 172.21.15.143:0/409503378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0210163250 msgr2=0x7f02100cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f02067fc640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0210163250 0x7f02100cac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f02067fc640 1 -- 172.21.15.143:0/409503378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02100d19c0 msgr2=0x7f0210158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f02067fc640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02100d19c0 0x7f0210158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f02067fc640 1 -- 172.21.15.143:0/409503378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021015bbb0 con 0x7f021015f5a0 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f020effd640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02100d19c0 0x7f0210158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f02067fc640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f021015f5a0 0x7f021015b670 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c440 tx=0x7f01f800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f0207fff640 1 -- 172.21.15.143:0/409503378 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8017070 con 0x7f021015f5a0 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f0207fff640 1 -- 172.21.15.143:0/409503378 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f80035f0 con 0x7f021015f5a0 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0210159730 con 0x7f021015f5a0 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.743+0000 7f0207fff640 1 -- 172.21.15.143:0/409503378 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f80039e0 con 0x7f021015f5a0 2024-05-08T10:24:45.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.744+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021015a8b0 con 0x7f021015f5a0 2024-05-08T10:24:45.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.744+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021006a550 con 0x7f021015f5a0 2024-05-08T10:24:45.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.745+0000 7f0207fff640 1 -- 172.21.15.143:0/409503378 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f01f801a070 con 0x7f021015f5a0 2024-05-08T10:24:45.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.746+0000 7f0207fff640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f01f00762d0 0x7f01f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:45.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.746+0000 7f020effd640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f01f00762d0 0x7f01f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:45.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.746+0000 7f0207fff640 1 -- 172.21.15.143:0/409503378 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f01f8096910 con 0x7f021015f5a0 2024-05-08T10:24:45.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.746+0000 7f020effd640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f01f00762d0 0x7f01f0078790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0200006fd0 tx=0x7f0200008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:45.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.750+0000 7f0207fff640 1 -- 172.21.15.143:0/409503378 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f01f80602a0 con 0x7f021015f5a0 2024-05-08T10:24:45.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:45.967+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f02100d3170 con 0x7f021015f5a0 2024-05-08T10:24:46.606 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.621+0000 7f0207fff640 1 -- 172.21.15.143:0/409503378 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f01f80010c0 con 0x7f021015f5a0 2024-05-08T10:24:46.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f01f00762d0 msgr2=0x7f01f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f01f00762d0 0x7f01f0078790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0200006fd0 tx=0x7f0200008040 comp rx=0 tx=0).stop 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f021015f5a0 msgr2=0x7f021015b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f021015f5a0 0x7f021015b670 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c440 tx=0x7f01f800c900 comp rx=0 tx=0).stop 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 shutdown_connections 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0210163250 0x7f02100cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f01f00762d0 0x7f01f0078790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f021015f5a0 0x7f021015b670 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 --2- 172.21.15.143:0/409503378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02100d19c0 0x7f0210158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 >> 172.21.15.143:0/409503378 conn(0x7f0210074080 msgr2=0x7f02100ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 shutdown_connections 2024-05-08T10:24:46.609 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.623+0000 7f021536a640 1 -- 172.21.15.143:0/409503378 wait complete. 2024-05-08T10:24:46.621 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T10:24:46.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.743+0000 7f6d390c4640 1 Processor -- start 2024-05-08T10:24:46.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.743+0000 7f6d390c4640 1 -- start start 2024-05-08T10:24:46.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d390c4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6d340b7380 0x7f6d3406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d390c4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d3406fe60 con 0x7f6d341608b0 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d390c4640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d340cf850 con 0x7f6d34068110 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d390c4640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f6d3406c320 con 0x7f6d340b7380 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d32d9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6d341608b0 0x7f6d340b6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52400/0 (socket says 172.21.15.143:52400) 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d32d9d640 1 -- 172.21.15.143:0/41941049 learned_addr learned my addr 172.21.15.143:0/41941049 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619806179 0 0) 0x7f6d3406fe60 con 0x7f6d341608b0 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d20003520 con 0x7f6d341608b0 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d2bfff640 1 --2- 172.21.15.143:0/41941049 >> v2:172.21.15.163:3300/0 conn(0x7f6d340b7380 0x7f6d3406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3210718265 0 0) 0x7f6d20003520 con 0x7f6d341608b0 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 >> v2:172.21.15.163:3300/0 conn(0x7f6d340b7380 msgr2=0x7f6d3406c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d3259c640 1 --2- 172.21.15.143:0/41941049 >> v2:172.21.15.163:3300/0 conn(0x7f6d340b7380 0x7f6d3406c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 >> v1:172.21.15.163:6789/0 conn(0x7f6d34068110 legacy=0x7f6d3406ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:46.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.744+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d340cfb30 con 0x7f6d341608b0 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f6d240016f0 con 0x7f6d341608b0 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 >> v1:172.21.15.143:6789/0 conn(0x7f6d341608b0 legacy=0x7f6d340b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3259c640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d20003a00 0x7f6d20003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3259c640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6d20004800 0x7f6d20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3259c640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d200052e0 0x7f6d2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3406c320 con 0x7f6d200052e0 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2000c200 con 0x7f6d20003a00 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2000c400 con 0x7f6d20004800 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3359e640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d200052e0 0x7f6d2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d32d9d640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d20003a00 0x7f6d20003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d2bfff640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6d20004800 0x7f6d20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:46.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3359e640 1 -- 172.21.15.143:0/41941049 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6d20004800 msgr2=0x7f6d20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3359e640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6d20004800 0x7f6d20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3359e640 1 -- 172.21.15.143:0/41941049 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d20003a00 msgr2=0x7f6d20003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3359e640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d20003a00 0x7f6d20003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d3359e640 1 -- 172.21.15.143:0/41941049 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d20003520 con 0x7f6d200052e0 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.745+0000 7f6d2bfff640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6d20004800 0x7f6d20004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d3359e640 1 -- 172.21.15.143:0/41941049 reap_dead start 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d3359e640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d200052e0 0x7f6d2000b9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0044b0 tx=0x7f6d20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97213a7e308c0aa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c004080 con 0x7f6d200052e0 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c02ada0 con 0x7f6d200052e0 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d3259c640 1 -- 172.21.15.143:0/41941049 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c006d90 con 0x7f6d200052e0 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d390c4640 1 -- 172.21.15.143:0/41941049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d200052e0 msgr2=0x7f6d2000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:46.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d390c4640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d200052e0 0x7f6d2000b9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0044b0 tx=0x7f6d20005830 comp rx=0 tx=0).stop 2024-05-08T10:24:46.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d390c4640 1 -- 172.21.15.143:0/41941049 shutdown_connections 2024-05-08T10:24:46.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d390c4640 1 --2- 172.21.15.143:0/41941049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d200052e0 0x7f6d2000b9c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d390c4640 1 -- 172.21.15.143:0/41941049 >> 172.21.15.143:0/41941049 conn(0x7f6d340cf2a0 msgr2=0x7f6d34072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:46.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d390c4640 1 -- 172.21.15.143:0/41941049 shutdown_connections 2024-05-08T10:24:46.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.746+0000 7f6d390c4640 1 -- 172.21.15.143:0/41941049 wait complete. 2024-05-08T10:24:46.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.748+0000 7f6d390c4640 1 Processor -- start 2024-05-08T10:24:46.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.748+0000 7f6d390c4640 1 -- start start 2024-05-08T10:24:46.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.748+0000 7f6d390c4640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d200052e0 0x7f6d341f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.748+0000 7f6d390c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d341f3b60 0x7f6d341f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.748+0000 7f6d390c4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6d341f2d70 0x7f6d34153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.748+0000 7f6d390c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6d340b1160 con 0x7f6d341f3b60 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.748+0000 7f6d390c4640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6d340b0fe0 con 0x7f6d200052e0 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.748+0000 7f6d390c4640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3406f8b0 con 0x7f6d341f2d70 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.748+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d341f3b60 0x7f6d341f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d341f3b60 0x7f6d341f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54982/0 (socket says 172.21.15.143:54982) 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2bfff640 1 -- 172.21.15.143:0/615875665 learned_addr learned my addr 172.21.15.143:0/615875665 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2bfff640 1 -- 172.21.15.143:0/615875665 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6d341f2d70 msgr2=0x7f6d34153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2bfff640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6d341f2d70 0x7f6d34153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d32d9d640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d200052e0 0x7f6d341f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2bfff640 1 -- 172.21.15.143:0/615875665 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d200052e0 msgr2=0x7f6d341f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:46.739 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2bfff640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d200052e0 0x7f6d341f0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2bfff640 1 -- 172.21.15.143:0/615875665 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d341e6540 con 0x7f6d341f3b60 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2bfff640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d341f3b60 0x7f6d341f2830 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00f550 tx=0x7f6d1c00fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2b7fe640 1 -- 172.21.15.143:0/615875665 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c013810 con 0x7f6d341f3b60 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2b7fe640 1 -- 172.21.15.143:0/615875665 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c01a070 con 0x7f6d341f3b60 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d2b7fe640 1 -- 172.21.15.143:0/615875665 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c013bb0 con 0x7f6d341f3b60 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d341f46f0 con 0x7f6d341f3b60 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.749+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d341f4cb0 con 0x7f6d341f3b60 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.750+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3406a550 con 0x7f6d341f3b60 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.751+0000 7f6d2b7fe640 1 -- 172.21.15.143:0/615875665 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d1c012070 con 0x7f6d341f3b60 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.751+0000 7f6d2b7fe640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6d14076300 0x7f6d140787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.751+0000 7f6d32d9d640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6d14076300 0x7f6d140787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.751+0000 7f6d2b7fe640 1 -- 172.21.15.143:0/615875665 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f6d1c097600 con 0x7f6d341f3b60 2024-05-08T10:24:46.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.752+0000 7f6d32d9d640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6d14076300 0x7f6d140787c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d34073230 tx=0x7f6d24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:46.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.756+0000 7f6d2b7fe640 1 -- 172.21.15.143:0/615875665 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6d1c060f00 con 0x7f6d341f3b60 2024-05-08T10:24:46.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:46.937+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d340b0ab0 con 0x7f6d341f3b60 2024-05-08T10:24:47.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.628+0000 7f6d2b7fe640 1 -- 172.21.15.143:0/615875665 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) ==== 181+0+0 (secure 0 0 0) 0x7f6d1c060800 con 0x7f6d341f3b60 2024-05-08T10:24:47.614 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_metadata' removed 2024-05-08T10:24:47.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6d14076300 msgr2=0x7f6d140787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:47.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6d14076300 0x7f6d140787c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d34073230 tx=0x7f6d24009040 comp rx=0 tx=0).stop 2024-05-08T10:24:47.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d341f3b60 msgr2=0x7f6d341f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:47.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d341f3b60 0x7f6d341f2830 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00f550 tx=0x7f6d1c00fa10 comp rx=0 tx=0).stop 2024-05-08T10:24:47.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 shutdown_connections 2024-05-08T10:24:47.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6d341f2d70 0x7f6d34153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:47.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6d14076300 0x7f6d140787c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:47.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d341f3b60 0x7f6d341f2830 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:47.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 --2- 172.21.15.143:0/615875665 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d200052e0 0x7f6d341f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:47.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.631+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 >> 172.21.15.143:0/615875665 conn(0x7f6d340cf2a0 msgr2=0x7f6d340b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:47.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.632+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 shutdown_connections 2024-05-08T10:24:47.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.632+0000 7f6d390c4640 1 -- 172.21.15.143:0/615875665 wait complete. 2024-05-08T10:24:47.631 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T10:24:47.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.753+0000 7f93f13e5640 1 Processor -- start 2024-05-08T10:24:47.738 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.753+0000 7f93f13e5640 1 -- start start 2024-05-08T10:24:47.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93f13e5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec15f4a0 0x7f93ec0d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:47.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93f13e5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f93ec0baf00 0x7f93ec0d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:47.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93f13e5640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93ec0b9cf0 con 0x7f93ec0d3800 2024-05-08T10:24:47.741 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93f13e5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec0d3370 con 0x7f93ec0baf00 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93f13e5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec0b9fd0 con 0x7f93ec15f4a0 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93ea7fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f93ec0baf00 0x7f93ec0d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93ea7fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f93ec0baf00 0x7f93ec0d26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54998/0 (socket says 172.21.15.143:54998) 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93ea7fc640 1 -- 172.21.15.143:0/1228664106 learned_addr learned my addr 172.21.15.143:0/1228664106 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93eaffd640 1 --2- 172.21.15.143:0/1228664106 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec15f4a0 0x7f93ec0d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93ea7fc640 1 -- 172.21.15.143:0/1228664106 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec15f4a0 msgr2=0x7f93ec0d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93ea7fc640 1 --2- 172.21.15.143:0/1228664106 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec15f4a0 0x7f93ec0d2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93ea7fc640 1 -- 172.21.15.143:0/1228664106 >> v1:172.21.15.163:6789/0 conn(0x7f93ec0d3800 legacy=0x7f93ec0d3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.754+0000 7f93ea7fc640 1 -- 172.21.15.143:0/1228664106 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec0ba2b0 con 0x7f93ec0baf00 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.755+0000 7f93ea7fc640 1 --2- 172.21.15.143:0/1228664106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec0baf00 0x7f93ec0d26d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009870 tx=0x7f93e002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b488fb8a486ab1f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:47.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.755+0000 7f93e9ffb640 1 -- 172.21.15.143:0/1228664106 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0037070 con 0x7f93ec0baf00 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.755+0000 7f93e9ffb640 1 -- 172.21.15.143:0/1228664106 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e002ae50 con 0x7f93ec0baf00 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.755+0000 7f93e9ffb640 1 -- 172.21.15.143:0/1228664106 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0032860 con 0x7f93ec0baf00 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.756+0000 7f93f13e5640 1 -- 172.21.15.143:0/1228664106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec0baf00 msgr2=0x7f93ec0d26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.756+0000 7f93f13e5640 1 --2- 172.21.15.143:0/1228664106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec0baf00 0x7f93ec0d26d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009870 tx=0x7f93e002a300 comp rx=0 tx=0).stop 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.756+0000 7f93f13e5640 1 -- 172.21.15.143:0/1228664106 shutdown_connections 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.756+0000 7f93f13e5640 1 --2- 172.21.15.143:0/1228664106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec0baf00 0x7f93ec0d26d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.756+0000 7f93f13e5640 1 --2- 172.21.15.143:0/1228664106 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec15f4a0 0x7f93ec0d2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.756+0000 7f93f13e5640 1 -- 172.21.15.143:0/1228664106 >> 172.21.15.143:0/1228664106 conn(0x7f93ec073e70 msgr2=0x7f93ec074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.756+0000 7f93f13e5640 1 -- 172.21.15.143:0/1228664106 shutdown_connections 2024-05-08T10:24:47.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.756+0000 7f93f13e5640 1 -- 172.21.15.143:0/1228664106 wait complete. 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.757+0000 7f93f13e5640 1 Processor -- start 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.757+0000 7f93f13e5640 1 -- start start 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93f13e5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec0baf00 0x7f93ec162330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93f13e5640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93ec0d3800 0x7f93ec160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93f13e5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec15f4a0 0x7f93ec0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93f13e5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0d4520 con 0x7f93ec15f4a0 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93f13e5640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0d43a0 con 0x7f93ec0d3800 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93f13e5640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec0d46a0 con 0x7f93ec0baf00 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec15f4a0 0x7f93ec0cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:47.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec15f4a0 0x7f93ec0cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55006/0 (socket says 172.21.15.143:55006) 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eb7fe640 1 -- 172.21.15.143:0/2421393548 learned_addr learned my addr 172.21.15.143:0/2421393548 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93ea7fc640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93ec0d3800 0x7f93ec160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eaffd640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec0baf00 0x7f93ec162330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eb7fe640 1 -- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec0baf00 msgr2=0x7f93ec162330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eb7fe640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec0baf00 0x7f93ec162330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eb7fe640 1 -- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93ec0d3800 msgr2=0x7f93ec160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eb7fe640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93ec0d3800 0x7f93ec160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eb7fe640 1 -- 172.21.15.143:0/2421393548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec162870 con 0x7f93ec15f4a0 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eaffd640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec0baf00 0x7f93ec162330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93ea7fc640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93ec0d3800 0x7f93ec160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.758+0000 7f93eb7fe640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec15f4a0 0x7f93ec0cb250 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c7a0 tx=0x7f93e400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.759+0000 7f93d37fe640 1 -- 172.21.15.143:0/2421393548 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4003b70 con 0x7f93ec15f4a0 2024-05-08T10:24:47.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.759+0000 7f93d37fe640 1 -- 172.21.15.143:0/2421393548 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e4003d10 con 0x7f93ec15f4a0 2024-05-08T10:24:47.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.759+0000 7f93d37fe640 1 -- 172.21.15.143:0/2421393548 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e400aa70 con 0x7f93ec15f4a0 2024-05-08T10:24:47.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.759+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec0cf220 con 0x7f93ec15f4a0 2024-05-08T10:24:47.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.759+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec0ce000 con 0x7f93ec15f4a0 2024-05-08T10:24:47.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.760+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec06a550 con 0x7f93ec15f4a0 2024-05-08T10:24:47.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.760+0000 7f93d37fe640 1 -- 172.21.15.143:0/2421393548 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93e400ac10 con 0x7f93ec15f4a0 2024-05-08T10:24:47.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.761+0000 7f93d37fe640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f93d80762d0 0x7f93d8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:47.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.761+0000 7f93eaffd640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f93d80762d0 0x7f93d8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:47.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.761+0000 7f93d37fe640 1 -- 172.21.15.143:0/2421393548 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5357+0+0 (secure 0 0 0) 0x7f93e4097370 con 0x7f93ec15f4a0 2024-05-08T10:24:47.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.761+0000 7f93eaffd640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f93d80762d0 0x7f93d8078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00b9f0 tx=0x7f93dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:47.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.765+0000 7f93d37fe640 1 -- 172.21.15.143:0/2421393548 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f93e4060ec0 con 0x7f93ec15f4a0 2024-05-08T10:24:47.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:47.948+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f93ec15dd30 con 0x7f93ec15f4a0 2024-05-08T10:24:48.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.635+0000 7f93d37fe640 1 -- 172.21.15.143:0/2421393548 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) ==== 169+0+0 (secure 0 0 0) 0x7f93e4095e20 con 0x7f93ec15f4a0 2024-05-08T10:24:48.621 INFO:teuthology.orchestra.run.smithi143.stderr:pool 'cephfs_data' removed 2024-05-08T10:24:48.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f93d80762d0 msgr2=0x7f93d8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:48.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f93d80762d0 0x7f93d8078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00b9f0 tx=0x7f93dc008040 comp rx=0 tx=0).stop 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec15f4a0 msgr2=0x7f93ec0cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec15f4a0 0x7f93ec0cb250 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c7a0 tx=0x7f93e400cc60 comp rx=0 tx=0).stop 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 shutdown_connections 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f93d80762d0 0x7f93d8078790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec15f4a0 0x7f93ec0cb250 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93ec0d3800 0x7f93ec160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 --2- 172.21.15.143:0/2421393548 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93ec0baf00 0x7f93ec162330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 >> 172.21.15.143:0/2421393548 conn(0x7f93ec073e70 msgr2=0x7f93ec0d4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 shutdown_connections 2024-05-08T10:24:48.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.638+0000 7f93f13e5640 1 -- 172.21.15.143:0/2421393548 wait complete. 2024-05-08T10:24:48.637 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-08T10:24:48.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.755+0000 7f6480759640 1 Processor -- start 2024-05-08T10:24:48.740 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.755+0000 7f6480759640 1 -- start start 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.756+0000 7f6480759640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64781603f0 0x7f64781607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.756+0000 7f6480759640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f64780b5f10 0x7f647815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.756+0000 7f6480759640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64780b4e70 con 0x7f647815d3b0 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.756+0000 7f6480759640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f64780b6370 con 0x7f64780b5f10 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.756+0000 7f6480759640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f64780b5150 con 0x7f64781603f0 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.756+0000 7f647dcf4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f64780b5f10 0x7f647815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.757+0000 7f647e4f5640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64781603f0 0x7f64781607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.757+0000 7f647dcf4640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f64780b5f10 0x7f647815ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:47870/0 (socket says 172.21.15.143:47870) 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.757+0000 7f647dcf4640 1 -- 172.21.15.143:0/49091967 learned_addr learned my addr 172.21.15.143:0/49091967 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:48.742 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.757+0000 7f647e4f5640 1 -- 172.21.15.143:0/49091967 >> v2:172.21.15.163:3300/0 conn(0x7f64780b5f10 msgr2=0x7f647815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:48.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.757+0000 7f647e4f5640 1 --2- 172.21.15.143:0/49091967 >> v2:172.21.15.163:3300/0 conn(0x7f64780b5f10 0x7f647815ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.757+0000 7f647e4f5640 1 -- 172.21.15.143:0/49091967 >> v1:172.21.15.163:6789/0 conn(0x7f647815d3b0 legacy=0x7f64780d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:48.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.757+0000 7f647e4f5640 1 -- 172.21.15.143:0/49091967 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64780b5430 con 0x7f64781603f0 2024-05-08T10:24:48.743 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.757+0000 7f647dcf4640 1 --2- 172.21.15.143:0/49091967 >> v2:172.21.15.163:3300/0 conn(0x7f64780b5f10 0x7f647815ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:48.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f647e4f5640 1 --2- 172.21.15.143:0/49091967 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64781603f0 0x7f64781607d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6474009d90 tx=0x7f647402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a55cb1e4bbd6105c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:48.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f647d4f3640 1 -- 172.21.15.143:0/49091967 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474007740 con 0x7f64781603f0 2024-05-08T10:24:48.744 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f647d4f3640 1 -- 172.21.15.143:0/49091967 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64740078e0 con 0x7f64781603f0 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f647d4f3640 1 -- 172.21.15.143:0/49091967 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474007cb0 con 0x7f64781603f0 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f6480759640 1 -- 172.21.15.143:0/49091967 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64781603f0 msgr2=0x7f64781607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f6480759640 1 --2- 172.21.15.143:0/49091967 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64781603f0 0x7f64781607d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6474009d90 tx=0x7f647402a660 comp rx=0 tx=0).stop 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f6480759640 1 -- 172.21.15.143:0/49091967 shutdown_connections 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f6480759640 1 --2- 172.21.15.143:0/49091967 >> v2:172.21.15.163:3300/0 conn(0x7f64780b5f10 0x7f647815ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f6480759640 1 --2- 172.21.15.143:0/49091967 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64781603f0 0x7f64781607d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f6480759640 1 -- 172.21.15.143:0/49091967 >> 172.21.15.143:0/49091967 conn(0x7f647806c500 msgr2=0x7f647806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f6480759640 1 -- 172.21.15.143:0/49091967 shutdown_connections 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.758+0000 7f6480759640 1 -- 172.21.15.143:0/49091967 wait complete. 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.760+0000 7f6480759640 1 Processor -- start 2024-05-08T10:24:48.745 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.760+0000 7f6480759640 1 -- start start 2024-05-08T10:24:48.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.760+0000 7f6480759640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64780b5f10 0x7f6478150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:48.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.760+0000 7f6480759640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f647815d3b0 0x7f64780af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:48.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.760+0000 7f6480759640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64781603f0 0x7f647815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:48.747 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.760+0000 7f6480759640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f64780d1980 con 0x7f64781603f0 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.760+0000 7f6480759640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f64780b59f0 con 0x7f64780b5f10 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.760+0000 7f6480759640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f64780d1b00 con 0x7f647815d3b0 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647ecf6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64781603f0 0x7f647815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647ecf6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64781603f0 0x7f647815b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55012/0 (socket says 172.21.15.143:55012) 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647ecf6640 1 -- 172.21.15.143:0/4265266994 learned_addr learned my addr 172.21.15.143:0/4265266994 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647dcf4640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f647815d3b0 0x7f64780af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647e4f5640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64780b5f10 0x7f6478150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647ecf6640 1 -- 172.21.15.143:0/4265266994 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f647815d3b0 msgr2=0x7f64780af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647ecf6640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f647815d3b0 0x7f64780af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647ecf6640 1 -- 172.21.15.143:0/4265266994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64780b5f10 msgr2=0x7f6478150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647ecf6640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64780b5f10 0x7f6478150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647ecf6640 1 -- 172.21.15.143:0/4265266994 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64780afdf0 con 0x7f64781603f0 2024-05-08T10:24:48.748 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f647ecf6640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64781603f0 0x7f647815b280 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f647000c3c0 tx=0x7f647000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:48.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f646effd640 1 -- 172.21.15.143:0/4265266994 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470017070 con 0x7f64781603f0 2024-05-08T10:24:48.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64780b00d0 con 0x7f64781603f0 2024-05-08T10:24:48.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f646effd640 1 -- 172.21.15.143:0/4265266994 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64700052d0 con 0x7f64781603f0 2024-05-08T10:24:48.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f646effd640 1 -- 172.21.15.143:0/4265266994 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470003810 con 0x7f64781603f0 2024-05-08T10:24:48.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.761+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64780b0690 con 0x7f64781603f0 2024-05-08T10:24:48.749 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.762+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647806a550 con 0x7f64781603f0 2024-05-08T10:24:48.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.763+0000 7f646effd640 1 -- 172.21.15.143:0/4265266994 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f647001a070 con 0x7f64781603f0 2024-05-08T10:24:48.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.763+0000 7f646effd640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f645c0762d0 0x7f645c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:48.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.763+0000 7f646effd640 1 -- 172.21.15.143:0/4265266994 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f6470096680 con 0x7f64781603f0 2024-05-08T10:24:48.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.763+0000 7f647e4f5640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f645c0762d0 0x7f645c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:48.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.764+0000 7f647e4f5640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f645c0762d0 0x7f645c078790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6474034000 tx=0x7f647402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:48.752 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.768+0000 7f646effd640 1 -- 172.21.15.143:0/4265266994 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f647005fb80 con 0x7f64781603f0 2024-05-08T10:24:48.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.948+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f64780b4bb0 con 0x7f64781603f0 2024-05-08T10:24:48.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.951+0000 7f646effd640 1 -- 172.21.15.143:0/4265266994 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f6470063e80 con 0x7f64781603f0 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f645c0762d0 msgr2=0x7f645c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f645c0762d0 0x7f645c078790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6474034000 tx=0x7f647402f000 comp rx=0 tx=0).stop 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64781603f0 msgr2=0x7f647815b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64781603f0 0x7f647815b280 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f647000c3c0 tx=0x7f647000c880 comp rx=0 tx=0).stop 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 shutdown_connections 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f645c0762d0 0x7f645c078790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64781603f0 0x7f647815b280 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f647815d3b0 0x7f64780af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 --2- 172.21.15.143:0/4265266994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64780b5f10 0x7f6478150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.953+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 >> 172.21.15.143:0/4265266994 conn(0x7f647806c500 msgr2=0x7f6478152820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:48.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.954+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 shutdown_connections 2024-05-08T10:24:48.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:48.954+0000 7f6480759640 1 -- 172.21.15.143:0/4265266994 wait complete. 2024-05-08T10:24:48.950 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-05-08T10:24:49.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.065+0000 7fd6926da640 1 Processor -- start 2024-05-08T10:24:49.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.065+0000 7fd6926da640 1 -- start start 2024-05-08T10:24:49.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd6926da640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd68c072510 0x7fd68c06fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:49.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd6926da640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd68c070230 0x7fd68c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:49.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd6926da640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68c0b4050 con 0x7fd68c15bf20 2024-05-08T10:24:49.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd6926da640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd68c073f70 con 0x7fd68c072510 2024-05-08T10:24:49.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd6926da640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fd68c0b4330 con 0x7fd68c070230 2024-05-08T10:24:49.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd68b7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd68c072510 0x7fd68c06fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:49.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd68bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd68c15bf20 0x7fd68c073860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52408/0 (socket says 172.21.15.143:52408) 2024-05-08T10:24:49.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd68bfff640 1 -- 172.21.15.143:0/2816599 learned_addr learned my addr 172.21.15.143:0/2816599 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:49.054 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd68b7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd68c072510 0x7fd68c06fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55022/0 (socket says 172.21.15.143:55022) 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd68b7fe640 1 -- 172.21.15.143:0/2816599 >> v2:172.21.15.163:3300/0 conn(0x7fd68c070230 msgr2=0x7fd68c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd690c77640 1 --2- 172.21.15.143:0/2816599 >> v2:172.21.15.163:3300/0 conn(0x7fd68c070230 0x7fd68c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd68affd640 1 -- 172.21.15.143:0/2816599 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1839587965 0 0) 0x7fd68c0b4050 con 0x7fd68c15bf20 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd68b7fe640 1 --2- 172.21.15.143:0/2816599 >> v2:172.21.15.163:3300/0 conn(0x7fd68c070230 0x7fd68c0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd68b7fe640 1 -- 172.21.15.143:0/2816599 >> v1:172.21.15.143:6789/0 conn(0x7fd68c15bf20 legacy=0x7fd68c073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd68b7fe640 1 -- 172.21.15.143:0/2816599 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c0b4610 con 0x7fd68c072510 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.066+0000 7fd690c77640 1 --2- 172.21.15.143:0/2816599 >> v2:172.21.15.163:3300/0 conn(0x7fd68c070230 0x7fd68c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.067+0000 7fd68b7fe640 1 --2- 172.21.15.143:0/2816599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c072510 0x7fd68c06fcf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd68c072e00 tx=0x7fd68002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8a39bccf812b15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.067+0000 7fd68affd640 1 -- 172.21.15.143:0/2816599 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680037070 con 0x7fd68c072510 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.067+0000 7fd68affd640 1 -- 172.21.15.143:0/2816599 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd680032440 con 0x7fd68c072510 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.067+0000 7fd68affd640 1 -- 172.21.15.143:0/2816599 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680032810 con 0x7fd68c072510 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.067+0000 7fd6926da640 1 -- 172.21.15.143:0/2816599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c072510 msgr2=0x7fd68c06fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:49.055 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.067+0000 7fd6926da640 1 --2- 172.21.15.143:0/2816599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c072510 0x7fd68c06fcf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd68c072e00 tx=0x7fd68002a1a0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.067+0000 7fd6926da640 1 -- 172.21.15.143:0/2816599 shutdown_connections 2024-05-08T10:24:49.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.067+0000 7fd6926da640 1 --2- 172.21.15.143:0/2816599 >> v2:172.21.15.163:3300/0 conn(0x7fd68c070230 0x7fd68c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.067+0000 7fd6926da640 1 --2- 172.21.15.143:0/2816599 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c072510 0x7fd68c06fcf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.068+0000 7fd6926da640 1 -- 172.21.15.143:0/2816599 >> 172.21.15.143:0/2816599 conn(0x7fd68c0b2bb0 msgr2=0x7fd68c0b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:49.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.068+0000 7fd6926da640 1 -- 172.21.15.143:0/2816599 shutdown_connections 2024-05-08T10:24:49.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.068+0000 7fd6926da640 1 -- 172.21.15.143:0/2816599 wait complete. 2024-05-08T10:24:49.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.069+0000 7fd6926da640 1 Processor -- start 2024-05-08T10:24:49.056 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.069+0000 7fd6926da640 1 -- start start 2024-05-08T10:24:49.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd6926da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c070230 0x7fd68c1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:49.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd6926da640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd68c072510 0x7fd68c14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd6926da640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd68c15bf20 0x7fd68c14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd6926da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c15c480 con 0x7fd68c070230 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd6926da640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c15c300 con 0x7fd68c072510 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd6926da640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c0aef50 con 0x7fd68c15bf20 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c070230 0x7fd68c1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c070230 0x7fd68c1499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55036/0 (socket says 172.21.15.143:55036) 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68bfff640 1 -- 172.21.15.143:0/798906919 learned_addr learned my addr 172.21.15.143:0/798906919 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68b7fe640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd68c072510 0x7fd68c14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd690c77640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd68c15bf20 0x7fd68c14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68bfff640 1 -- 172.21.15.143:0/798906919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd68c15bf20 msgr2=0x7fd68c14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68bfff640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd68c15bf20 0x7fd68c14c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68bfff640 1 -- 172.21.15.143:0/798906919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd68c072510 msgr2=0x7fd68c14be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68bfff640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd68c072510 0x7fd68c14be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.060 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68bfff640 1 -- 172.21.15.143:0/798906919 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c15dd00 con 0x7fd68c070230 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd690c77640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd68c15bf20 0x7fd68c14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd68bfff640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c070230 0x7fd68c1499b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c3e0 tx=0x7fd67c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd688ff9640 1 -- 172.21.15.143:0/798906919 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0074e0 con 0x7fd68c070230 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd688ff9640 1 -- 172.21.15.143:0/798906919 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67c0047e0 con 0x7fd68c070230 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c15dfe0 con 0x7fd68c070230 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd688ff9640 1 -- 172.21.15.143:0/798906919 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c004bd0 con 0x7fd68c070230 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.070+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c15e880 con 0x7fd68c070230 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.071+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd68c0b3ca0 con 0x7fd68c070230 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.072+0000 7fd688ff9640 1 -- 172.21.15.143:0/798906919 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd67c011070 con 0x7fd68c070230 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.072+0000 7fd688ff9640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd678076300 0x7fd6780787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.073+0000 7fd688ff9640 1 -- 172.21.15.143:0/798906919 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fd67c096e10 con 0x7fd68c070230 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.073+0000 7fd68b7fe640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd678076300 0x7fd6780787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:49.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.073+0000 7fd68b7fe640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd678076300 0x7fd6780787c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd680034000 tx=0x7fd68002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:49.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.077+0000 7fd688ff9640 1 -- 172.21.15.143:0/798906919 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd68c0b3ca0 con 0x7fd68c070230 2024-05-08T10:24:49.325 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.340+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) -- 0x7fd68c06a4b0 con 0x7fd68c070230 2024-05-08T10:24:49.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.636+0000 7fd688ff9640 1 -- 172.21.15.143:0/798906919 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v74) ==== 123+0+0 (secure 0 0 0) 0x7fd67c060a70 con 0x7fd68c070230 2024-05-08T10:24:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd678076300 msgr2=0x7fd6780787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd678076300 0x7fd6780787c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd680034000 tx=0x7fd68002e000 comp rx=0 tx=0).stop 2024-05-08T10:24:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c070230 msgr2=0x7fd68c1499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c070230 0x7fd68c1499b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c3e0 tx=0x7fd67c00c8a0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 shutdown_connections 2024-05-08T10:24:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd68c15bf20 0x7fd68c14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd68c072510 0x7fd68c14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fd678076300 0x7fd6780787c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 --2- 172.21.15.143:0/798906919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd68c070230 0x7fd68c1499b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:49.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 >> 172.21.15.143:0/798906919 conn(0x7fd68c0b2bb0 msgr2=0x7fd68c150660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:49.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 shutdown_connections 2024-05-08T10:24:49.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:49.639+0000 7fd6926da640 1 -- 172.21.15.143:0/798906919 wait complete. 2024-05-08T10:24:49.653 INFO:tasks.cephfs_test_runner:test_flush (tasks.cephfs.test_flush.TestFlush) ... ERROR 2024-05-08T10:24:49.653 INFO:tasks.cephfs_test_runner: 2024-05-08T10:24:49.653 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-08T10:24:49.653 INFO:tasks.cephfs_test_runner:ERROR: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-08T10:24:49.653 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-08T10:24:49.653 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/test_flush.py", line 51, in test_flush 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: self.assertEqual(summary_output, 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/unittest/case.py", line 912, in assertEqual 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: assertion_func(first, second, msg=msg) 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/unittest/case.py", line 1292, in assertMultiLineEqual 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: self.fail(self._formatMessage(msg, standardMsg)) 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/unittest/case.py", line 753, in fail 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: raise self.failureException(msg) 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner:AssertionError: 'Events by type:\n SUBTREEMAP: 1\n UPDATE: 1\nErrors: 0' != 'Events by type:\n SUBTREEMAP: 1\nErrors: 0' 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: Events by type: 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: SUBTREEMAP: 1 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner:- UPDATE: 1 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: Errors: 0 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner: 2024-05-08T10:24:49.654 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/test_flush.py", line 76, in test_flush 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: flush_data = self.fs.mds_asok(["flush", "journal"]) 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/filesystem.py", line 1361, in mds_asok 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: return self.rank_asok(*args, **kwargs) 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/filesystem.py", line 1386, in rank_asok 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/filesystem.py", line 1176, in get_rank 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: return status.get_rank(self.id, rank) 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/filesystem.py", line 174, in get_rank 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: raise NoSuchRank(fscid, rank) 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner:tasks.cephfs.filesystem.NoSuchRank: No such rank 2:0 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner: 2024-05-08T10:24:49.655 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner:Ran 1 test in 38.384s 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner: 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner: 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner:ERROR: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/test_flush.py", line 51, in test_flush 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner: self.assertEqual(summary_output, 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/unittest/case.py", line 912, in assertEqual 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner: assertion_func(first, second, msg=msg) 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/unittest/case.py", line 1292, in assertMultiLineEqual 2024-05-08T10:24:49.656 INFO:tasks.cephfs_test_runner: self.fail(self._formatMessage(msg, standardMsg)) 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/unittest/case.py", line 753, in fail 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: raise self.failureException(msg) 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner:AssertionError: 'Events by type:\n SUBTREEMAP: 1\n UPDATE: 1\nErrors: 0' != 'Events by type:\n SUBTREEMAP: 1\nErrors: 0' 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: Events by type: 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: SUBTREEMAP: 1 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner:- UPDATE: 1 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: Errors: 0 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/test_flush.py", line 76, in test_flush 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: flush_data = self.fs.mds_asok(["flush", "journal"]) 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/filesystem.py", line 1361, in mds_asok 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: return self.rank_asok(*args, **kwargs) 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/filesystem.py", line 1386, in rank_asok 2024-05-08T10:24:49.657 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2024-05-08T10:24:49.658 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/filesystem.py", line 1176, in get_rank 2024-05-08T10:24:49.658 INFO:tasks.cephfs_test_runner: return status.get_rank(self.id, rank) 2024-05-08T10:24:49.658 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs/filesystem.py", line 174, in get_rank 2024-05-08T10:24:49.658 INFO:tasks.cephfs_test_runner: raise NoSuchRank(fscid, rank) 2024-05-08T10:24:49.658 INFO:tasks.cephfs_test_runner:tasks.cephfs.filesystem.NoSuchRank: No such rank 2:0 2024-05-08T10:24:49.658 INFO:tasks.cephfs_test_runner: 2024-05-08T10:24:49.658 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-08T10:24:49.902 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c1e89243815047ddb2885ffa728a3b5b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_joscollin_ceph_486398014c80883074e0469d9aa7f4ebb8fab0b6/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-08T10:24:49.903 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-08T10:24:49.917 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-08T10:24:49.959 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-08T10:24:49.960 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:49.960 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:49.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20521 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T10:24:49.980 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-05-08T10:24:49.980 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:50.036 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20521 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T10:24:50.036 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:50.036 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:50.056 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056329,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16788 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T10:24:50.056 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-05-08T10:24:50.056 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:24:50.116 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056329,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16788 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T10:24:50.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.116 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-05-08T10:24:50.132 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T10:24:50.132 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T10:24:50.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.133 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T10:24:50.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.199 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T10:24:50.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.266 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-05-08T10:24:50.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.358 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-05-08T10:24:50.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.374 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-05-08T10:24:50.442 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2024-05-08T10:24:50.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:24:50.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.444 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-05-08T10:24:50.463 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-08T10:24:50.463 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T10:24:50.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.463 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T10:24:50.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.534 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T10:24:50.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.606 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2024-05-08T10:24:50.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.709 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2024-05-08T10:24:50.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:24:50.726 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2024-05-08T10:24:50.795 INFO:teuthology.orchestra.run.smithi163.stderr:Cannot find device "ceph-brx" 2024-05-08T10:24:50.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:24:50.797 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T10:24:50.807 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T10:24:50.808 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:50.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.923+0000 7fa3bac33640 1 Processor -- start 2024-05-08T10:24:50.909 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.923+0000 7fa3bac33640 1 -- start start 2024-05-08T10:24:50.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3bac33640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa3b415b8a0 0x7fa3b40725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:50.911 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3bac33640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b40b54d0 0x7fa3b40b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:50.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3bac33640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b40b5140 con 0x7fa3b40b46e0 2024-05-08T10:24:50.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3bac33640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa3b40af910 con 0x7fa3b415b8a0 2024-05-08T10:24:50.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3bac33640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b40b4b80 con 0x7fa3b40b54d0 2024-05-08T10:24:50.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3b89cf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa3b415b8a0 0x7fa3b40725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:50.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3b89cf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa3b415b8a0 0x7fa3b40725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55038/0 (socket says 172.21.15.143:55038) 2024-05-08T10:24:50.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3b89cf640 1 -- 172.21.15.143:0/3961880538 learned_addr learned my addr 172.21.15.143:0/3961880538 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:50.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3b3fff640 1 --2- 172.21.15.143:0/3961880538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b40b54d0 0x7fa3b40b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:50.912 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3b89cf640 1 -- 172.21.15.143:0/3961880538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b40b54d0 msgr2=0x7fa3b40b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:50.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3b89cf640 1 --2- 172.21.15.143:0/3961880538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b40b54d0 0x7fa3b40b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:50.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3b89cf640 1 -- 172.21.15.143:0/3961880538 >> v1:172.21.15.143:6789/0 conn(0x7fa3b40b46e0 legacy=0x7fa3b406f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:50.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3b89cf640 1 -- 172.21.15.143:0/3961880538 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b40b4e60 con 0x7fa3b415b8a0 2024-05-08T10:24:50.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.924+0000 7fa3b37fe640 1 -- 172.21.15.143:0/3961880538 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042392172 0 0) 0x7fa3b40b5140 con 0x7fa3b40b46e0 2024-05-08T10:24:50.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.925+0000 7fa3b89cf640 1 --2- 172.21.15.143:0/3961880538 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b415b8a0 0x7fa3b40725a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400bb10 tx=0x7fa3a402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a5a16b5b7e131c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:50.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.925+0000 7fa3b37fe640 1 -- 172.21.15.143:0/3961880538 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4036020 con 0x7fa3b415b8a0 2024-05-08T10:24:50.913 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.925+0000 7fa3b37fe640 1 -- 172.21.15.143:0/3961880538 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a4032820 con 0x7fa3b415b8a0 2024-05-08T10:24:50.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.925+0000 7fa3b37fe640 1 -- 172.21.15.143:0/3961880538 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4032bf0 con 0x7fa3b415b8a0 2024-05-08T10:24:50.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.926+0000 7fa3bac33640 1 -- 172.21.15.143:0/3961880538 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b415b8a0 msgr2=0x7fa3b40725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:50.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.926+0000 7fa3bac33640 1 --2- 172.21.15.143:0/3961880538 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b415b8a0 0x7fa3b40725a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400bb10 tx=0x7fa3a402c920 comp rx=0 tx=0).stop 2024-05-08T10:24:50.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.926+0000 7fa3bac33640 1 -- 172.21.15.143:0/3961880538 shutdown_connections 2024-05-08T10:24:50.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.926+0000 7fa3bac33640 1 --2- 172.21.15.143:0/3961880538 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b40b54d0 0x7fa3b40b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:50.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.926+0000 7fa3bac33640 1 --2- 172.21.15.143:0/3961880538 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b415b8a0 0x7fa3b40725a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:50.914 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.926+0000 7fa3bac33640 1 -- 172.21.15.143:0/3961880538 >> 172.21.15.143:0/3961880538 conn(0x7fa3b406c500 msgr2=0x7fa3b406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:50.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.926+0000 7fa3bac33640 1 -- 172.21.15.143:0/3961880538 shutdown_connections 2024-05-08T10:24:50.915 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.926+0000 7fa3bac33640 1 -- 172.21.15.143:0/3961880538 wait complete. 2024-05-08T10:24:50.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.927+0000 7fa3bac33640 1 Processor -- start 2024-05-08T10:24:50.917 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.927+0000 7fa3bac33640 1 -- start start 2024-05-08T10:24:50.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3bac33640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3b40b46e0 0x7fa3b40ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:50.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3bac33640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b40b54d0 0x7fa3b40b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:50.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3bac33640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b415b8a0 0x7fa3b40cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:50.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3bac33640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b4072c60 con 0x7fa3b40b54d0 2024-05-08T10:24:50.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3bac33640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b4072ae0 con 0x7fa3b40b46e0 2024-05-08T10:24:50.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3bac33640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b406f7a0 con 0x7fa3b415b8a0 2024-05-08T10:24:50.918 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b40b54d0 0x7fa3b40b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:50.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b40b54d0 0x7fa3b40b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55050/0 (socket says 172.21.15.143:55050) 2024-05-08T10:24:50.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b3fff640 1 -- 172.21.15.143:0/2891495938 learned_addr learned my addr 172.21.15.143:0/2891495938 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:50.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b89cf640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3b40b46e0 0x7fa3b40ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:50.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b91d0640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b415b8a0 0x7fa3b40cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:50.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b3fff640 1 -- 172.21.15.143:0/2891495938 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b415b8a0 msgr2=0x7fa3b40cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:50.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b3fff640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b415b8a0 0x7fa3b40cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:50.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b3fff640 1 -- 172.21.15.143:0/2891495938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3b40b46e0 msgr2=0x7fa3b40ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:50.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b3fff640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3b40b46e0 0x7fa3b40ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:50.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b3fff640 1 -- 172.21.15.143:0/2891495938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b40cdc70 con 0x7fa3b40b54d0 2024-05-08T10:24:50.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.928+0000 7fa3b3fff640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b40b54d0 0x7fa3b40b20a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800d830 tx=0x7fa3a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:50.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.929+0000 7fa3b17fa640 1 -- 172.21.15.143:0/2891495938 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a800b6c0 con 0x7fa3b40b54d0 2024-05-08T10:24:50.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.929+0000 7fa3b17fa640 1 -- 172.21.15.143:0/2891495938 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a8019070 con 0x7fa3b40b54d0 2024-05-08T10:24:50.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.929+0000 7fa3b17fa640 1 -- 172.21.15.143:0/2891495938 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a800ba80 con 0x7fa3b40b54d0 2024-05-08T10:24:50.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.929+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b40cdf50 con 0x7fa3b40b54d0 2024-05-08T10:24:50.920 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.929+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b40ce510 con 0x7fa3b40b54d0 2024-05-08T10:24:50.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.930+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b406a550 con 0x7fa3b40b54d0 2024-05-08T10:24:50.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.930+0000 7fa3b17fa640 1 -- 172.21.15.143:0/2891495938 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa3a801e460 con 0x7fa3b40b54d0 2024-05-08T10:24:50.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.931+0000 7fa3b17fa640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa3a00762d0 0x7fa3a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:50.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.931+0000 7fa3b89cf640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa3a00762d0 0x7fa3a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:50.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.931+0000 7fa3b17fa640 1 -- 172.21.15.143:0/2891495938 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fa3a8097840 con 0x7fa3b40b54d0 2024-05-08T10:24:50.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.931+0000 7fa3b89cf640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa3a00762d0 0x7fa3a0078790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4037000 tx=0x7fa3a403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:50.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:50.935+0000 7fa3b17fa640 1 -- 172.21.15.143:0/2891495938 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa3a8060e50 con 0x7fa3b40b54d0 2024-05-08T10:24:51.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.110+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3b415f030 con 0x7fa3a00762d0 2024-05-08T10:24:51.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.111+0000 7fa3b17fa640 1 -- 172.21.15.143:0/2891495938 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13360 (secure 0 0 0) 0x7fa3b415f030 con 0x7fa3a00762d0 2024-05-08T10:24:51.096 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:51.096 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:51.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa3a00762d0 msgr2=0x7fa3a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa3a00762d0 0x7fa3a0078790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4037000 tx=0x7fa3a403d040 comp rx=0 tx=0).stop 2024-05-08T10:24:51.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b40b54d0 msgr2=0x7fa3b40b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b40b54d0 0x7fa3b40b20a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800d830 tx=0x7fa3a800dcf0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.098 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 shutdown_connections 2024-05-08T10:24:51.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa3b415b8a0 0x7fa3b40cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa3a00762d0 0x7fa3a0078790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b40b54d0 0x7fa3b40b20a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 --2- 172.21.15.143:0/2891495938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa3b40b46e0 0x7fa3b40ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 >> 172.21.15.143:0/2891495938 conn(0x7fa3b406c500 msgr2=0x7fa3b415c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:51.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 shutdown_connections 2024-05-08T10:24:51.099 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.113+0000 7fa3bac33640 1 -- 172.21.15.143:0/2891495938 wait complete. 2024-05-08T10:24:51.109 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-08T10:24:50.535960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220224,"kb_used_data":4064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754496,"statfs":{"total":773094113280,"available":772868603904,"internally_reserved":0,"allocated":4161536,"data_stored":2331936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001463"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T10:24:42.716105+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:24:42.716105+0000","last_peered":"2024-05-08T10:24:42.716105+0000","last_clean":"2024-05-08T10:24:42.716105+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:42.716105+0000","last_undegraded":"2024-05-08T10:24:42.716105+0000","last_fullsized":"2024-05-08T10:24:42.716105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":730665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":154203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":154203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":730575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:51.109 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:51.209 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.224+0000 7fcc39740640 1 Processor -- start 2024-05-08T10:24:51.210 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.224+0000 7fcc39740640 1 -- start start 2024-05-08T10:24:51.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc39740640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc3415b8a0 0x7fcc340725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc39740640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc340b5140 con 0x7fcc3406f090 2024-05-08T10:24:51.211 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc39740640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc340b48b0 con 0x7fcc340b54d0 2024-05-08T10:24:51.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc39740640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fcc340af910 con 0x7fcc3415b8a0 2024-05-08T10:24:51.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc32ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc3415b8a0 0x7fcc340725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc32ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc3415b8a0 0x7fcc340725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55064/0 (socket says 172.21.15.143:55064) 2024-05-08T10:24:51.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc32ffd640 1 -- 172.21.15.143:0/1832650566 learned_addr learned my addr 172.21.15.143:0/1832650566 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:51.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc337fe640 1 --1- 172.21.15.143:0/1832650566 >> v1:172.21.15.143:6789/0 conn(0x7fcc3406f090 0x7fcc340afda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52418/0 (socket says 172.21.15.143:52418) 2024-05-08T10:24:51.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc32ffd640 1 -- 172.21.15.143:0/1832650566 >> v1:172.21.15.163:6789/0 conn(0x7fcc340b54d0 legacy=0x7fcc340b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc32ffd640 1 -- 172.21.15.143:0/1832650566 >> v1:172.21.15.143:6789/0 conn(0x7fcc3406f090 legacy=0x7fcc340afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.212 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.225+0000 7fcc32ffd640 1 -- 172.21.15.143:0/1832650566 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc340b4b80 con 0x7fcc3415b8a0 2024-05-08T10:24:51.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.226+0000 7fcc32ffd640 1 --2- 172.21.15.143:0/1832650566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc3415b8a0 0x7fcc340725a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009870 tx=0x7fcc2402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8126047bc97c8e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:51.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.226+0000 7fcc327fc640 1 -- 172.21.15.143:0/1832650566 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24037070 con 0x7fcc3415b8a0 2024-05-08T10:24:51.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.226+0000 7fcc327fc640 1 -- 172.21.15.143:0/1832650566 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2402ae50 con 0x7fcc3415b8a0 2024-05-08T10:24:51.213 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.226+0000 7fcc327fc640 1 -- 172.21.15.143:0/1832650566 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24032860 con 0x7fcc3415b8a0 2024-05-08T10:24:51.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.227+0000 7fcc39740640 1 -- 172.21.15.143:0/1832650566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc3415b8a0 msgr2=0x7fcc340725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.227+0000 7fcc39740640 1 --2- 172.21.15.143:0/1832650566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc3415b8a0 0x7fcc340725a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009870 tx=0x7fcc2402a300 comp rx=0 tx=0).stop 2024-05-08T10:24:51.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.227+0000 7fcc39740640 1 -- 172.21.15.143:0/1832650566 shutdown_connections 2024-05-08T10:24:51.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.227+0000 7fcc39740640 1 --2- 172.21.15.143:0/1832650566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc3415b8a0 0x7fcc340725a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.227+0000 7fcc39740640 1 -- 172.21.15.143:0/1832650566 >> 172.21.15.143:0/1832650566 conn(0x7fcc3406c500 msgr2=0x7fcc3406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:51.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.227+0000 7fcc39740640 1 -- 172.21.15.143:0/1832650566 shutdown_connections 2024-05-08T10:24:51.220 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.227+0000 7fcc39740640 1 -- 172.21.15.143:0/1832650566 wait complete. 2024-05-08T10:24:51.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.228+0000 7fcc39740640 1 Processor -- start 2024-05-08T10:24:51.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.228+0000 7fcc39740640 1 -- start start 2024-05-08T10:24:51.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc39740640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcc3406f090 0x7fcc341464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc39740640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc340b54d0 0x7fcc3415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc39740640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc3415b8a0 0x7fcc341f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc39740640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34072ae0 con 0x7fcc340b54d0 2024-05-08T10:24:51.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc39740640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcc340af5a0 con 0x7fcc3415b8a0 2024-05-08T10:24:51.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc39740640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fcc34072c60 con 0x7fcc3406f090 2024-05-08T10:24:51.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc2a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc340b54d0 0x7fcc3415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc2a7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc340b54d0 0x7fcc3415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55078/0 (socket says 172.21.15.143:55078) 2024-05-08T10:24:51.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc2a7fc640 1 -- 172.21.15.143:0/223558968 learned_addr learned my addr 172.21.15.143:0/223558968 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:51.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc32ffd640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcc3406f090 0x7fcc341464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc337fe640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc3415b8a0 0x7fcc341f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc2a7fc640 1 -- 172.21.15.143:0/223558968 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcc3406f090 msgr2=0x7fcc341464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc2a7fc640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcc3406f090 0x7fcc341464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc2a7fc640 1 -- 172.21.15.143:0/223558968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc3415b8a0 msgr2=0x7fcc341f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc2a7fc640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc3415b8a0 0x7fcc341f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc2a7fc640 1 -- 172.21.15.143:0/223558968 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3415dcb0 con 0x7fcc340b54d0 2024-05-08T10:24:51.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc337fe640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc3415b8a0 0x7fcc341f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:51.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.229+0000 7fcc2a7fc640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc340b54d0 0x7fcc3415cff0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c450 tx=0x7fcc1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:51.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.230+0000 7fcc2bfff640 1 -- 172.21.15.143:0/223558968 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0052d0 con 0x7fcc340b54d0 2024-05-08T10:24:51.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.230+0000 7fcc2bfff640 1 -- 172.21.15.143:0/223558968 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1c005470 con 0x7fcc340b54d0 2024-05-08T10:24:51.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.230+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3415df90 con 0x7fcc340b54d0 2024-05-08T10:24:51.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.230+0000 7fcc2bfff640 1 -- 172.21.15.143:0/223558968 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c012870 con 0x7fcc340b54d0 2024-05-08T10:24:51.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.230+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc34149f50 con 0x7fcc340b54d0 2024-05-08T10:24:51.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.231+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc3406a550 con 0x7fcc340b54d0 2024-05-08T10:24:51.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.231+0000 7fcc2bfff640 1 -- 172.21.15.143:0/223558968 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc1c012a10 con 0x7fcc340b54d0 2024-05-08T10:24:51.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.232+0000 7fcc2bfff640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcc140762d0 0x7fcc14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.232+0000 7fcc32ffd640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcc140762d0 0x7fcc14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.232+0000 7fcc2bfff640 1 -- 172.21.15.143:0/223558968 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fcc1c096ee0 con 0x7fcc340b54d0 2024-05-08T10:24:51.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.232+0000 7fcc32ffd640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcc140762d0 0x7fcc14078790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcc24034000 tx=0x7fcc2402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:51.225 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.236+0000 7fcc2bfff640 1 -- 172.21.15.143:0/223558968 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcc1c060b40 con 0x7fcc340b54d0 2024-05-08T10:24:51.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.412+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc3415da60 con 0x7fcc140762d0 2024-05-08T10:24:51.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.413+0000 7fcc2bfff640 1 -- 172.21.15.143:0/223558968 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13360 (secure 0 0 0) 0x7fcc3415da60 con 0x7fcc140762d0 2024-05-08T10:24:51.398 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:51.399 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcc140762d0 msgr2=0x7fcc14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcc140762d0 0x7fcc14078790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcc24034000 tx=0x7fcc2402e000 comp rx=0 tx=0).stop 2024-05-08T10:24:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc340b54d0 msgr2=0x7fcc3415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc340b54d0 0x7fcc3415cff0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c450 tx=0x7fcc1c00c910 comp rx=0 tx=0).stop 2024-05-08T10:24:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 shutdown_connections 2024-05-08T10:24:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc3415b8a0 0x7fcc341f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fcc140762d0 0x7fcc14078790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc340b54d0 0x7fcc3415cff0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 --2- 172.21.15.143:0/223558968 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcc3406f090 0x7fcc341464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 >> 172.21.15.143:0/223558968 conn(0x7fcc3406c500 msgr2=0x7fcc340b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 shutdown_connections 2024-05-08T10:24:51.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.415+0000 7fcc39740640 1 -- 172.21.15.143:0/223558968 wait complete. 2024-05-08T10:24:51.411 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-08T10:24:50.535960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220224,"kb_used_data":4064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754496,"statfs":{"total":773094113280,"available":772868603904,"internally_reserved":0,"allocated":4161536,"data_stored":2331936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001463"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T10:24:42.716105+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:24:42.716105+0000","last_peered":"2024-05-08T10:24:42.716105+0000","last_clean":"2024-05-08T10:24:42.716105+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:42.716105+0000","last_undegraded":"2024-05-08T10:24:42.716105+0000","last_fullsized":"2024-05-08T10:24:42.716105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":730665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":154203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":154203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":730575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:51.412 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T10:24:51.412 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:51.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.527+0000 7f076f875640 1 Processor -- start 2024-05-08T10:24:51.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.528+0000 7f076f875640 1 -- start start 2024-05-08T10:24:51.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.528+0000 7f076f875640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f07680d3a00 0x7f0768144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.528+0000 7f076f875640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f076815fca0 con 0x7f07681423c0 2024-05-08T10:24:51.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.528+0000 7f076f875640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f076815ff80 con 0x7f0768163800 2024-05-08T10:24:51.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.528+0000 7f076f875640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f07681608b0 con 0x7f07680d3a00 2024-05-08T10:24:51.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f076d611640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f07681423c0 0x7f0768142a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52430/0 (socket says 172.21.15.143:52430) 2024-05-08T10:24:51.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f076d611640 1 -- 172.21.15.143:0/2033365453 learned_addr learned my addr 172.21.15.143:0/2033365453 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:51.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f076de12640 1 --2- 172.21.15.143:0/2033365453 >> v2:172.21.15.163:3300/0 conn(0x7f07680d3a00 0x7f0768144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288822185 0 0) 0x7f076815fca0 con 0x7f07681423c0 2024-05-08T10:24:51.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0754003520 con 0x7f07681423c0 2024-05-08T10:24:51.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3404623455 0 0) 0x7f0754003520 con 0x7f07681423c0 2024-05-08T10:24:51.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 >> v2:172.21.15.163:3300/0 conn(0x7f07680d3a00 msgr2=0x7f0768144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:51.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 --2- 172.21.15.143:0/2033365453 >> v2:172.21.15.163:3300/0 conn(0x7f07680d3a00 0x7f0768144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 >> v1:172.21.15.163:6789/0 conn(0x7f0768163800 legacy=0x7f07680d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0768160260 con 0x7f07681423c0 2024-05-08T10:24:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f075c0016f0 con 0x7f07681423c0 2024-05-08T10:24:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 >> v1:172.21.15.143:6789/0 conn(0x7f07681423c0 legacy=0x7f0768142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0754003a50 0x7f0754003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f0754004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07540051c0 0x7f075400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f07681608b0 con 0x7f0754004800 2024-05-08T10:24:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f075400c160 con 0x7f07540051c0 2024-05-08T10:24:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f075400c360 con 0x7f0754003a50 2024-05-08T10:24:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f076ce10640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f0754004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f076d611640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0754003a50 0x7f0754003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.529+0000 7f076de12640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07540051c0 0x7f075400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f076ce10640 1 -- 172.21.15.143:0/2033365453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0754003a50 msgr2=0x7f0754003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f076ce10640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0754003a50 0x7f0754003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f076ce10640 1 -- 172.21.15.143:0/2033365453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07540051c0 msgr2=0x7f075400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f076ce10640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07540051c0 0x7f075400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f076ce10640 1 -- 172.21.15.143:0/2033365453 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0754003520 con 0x7f0754004800 2024-05-08T10:24:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f076de12640 1 -- 172.21.15.143:0/2033365453 reap_dead start 2024-05-08T10:24:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f076ce10640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f0754004c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0764001790 tx=0x7f0754005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec39e81fea9bf61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07640013b0 con 0x7f0754004800 2024-05-08T10:24:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07640052d0 con 0x7f0754004800 2024-05-08T10:24:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.530+0000 7f075bfff640 1 -- 172.21.15.143:0/2033365453 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076402aa90 con 0x7f0754004800 2024-05-08T10:24:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.531+0000 7f076f875640 1 -- 172.21.15.143:0/2033365453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 msgr2=0x7f0754004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.531+0000 7f076f875640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f0754004c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0764001790 tx=0x7f0754005830 comp rx=0 tx=0).stop 2024-05-08T10:24:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.531+0000 7f076f875640 1 -- 172.21.15.143:0/2033365453 shutdown_connections 2024-05-08T10:24:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.531+0000 7f076f875640 1 --2- 172.21.15.143:0/2033365453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f0754004c80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.531+0000 7f076f875640 1 -- 172.21.15.143:0/2033365453 >> 172.21.15.143:0/2033365453 conn(0x7f07680682f0 msgr2=0x7f0768068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:51.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.531+0000 7f076f875640 1 -- 172.21.15.143:0/2033365453 shutdown_connections 2024-05-08T10:24:51.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.531+0000 7f076f875640 1 -- 172.21.15.143:0/2033365453 wait complete. 2024-05-08T10:24:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.532+0000 7f076f875640 1 Processor -- start 2024-05-08T10:24:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.532+0000 7f076f875640 1 -- start start 2024-05-08T10:24:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076f875640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f07681413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076f875640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f07680ceb90 0x7f07681ea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076f875640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07680cefd0 0x7f07681ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076f875640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0768163220 con 0x7f0754004800 2024-05-08T10:24:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076f875640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f07681630a0 con 0x7f07680cefd0 2024-05-08T10:24:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076f875640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f076815f900 con 0x7f07680ceb90 2024-05-08T10:24:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076d611640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f07681413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076d611640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f07681413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55094/0 (socket says 172.21.15.143:55094) 2024-05-08T10:24:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076d611640 1 -- 172.21.15.143:0/2072488021 learned_addr learned my addr 172.21.15.143:0/2072488021 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:51.525 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076d611640 1 -- 172.21.15.143:0/2072488021 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f07680ceb90 msgr2=0x7f07681ea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076d611640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f07680ceb90 0x7f07681ea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076d611640 1 -- 172.21.15.143:0/2072488021 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07680cefd0 msgr2=0x7f07681ea6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076d611640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07680cefd0 0x7f07681ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076d611640 1 -- 172.21.15.143:0/2072488021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07681e9180 con 0x7f0754004800 2024-05-08T10:24:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.533+0000 7f076d611640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f07681413b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f075c004ef0 tx=0x7f075c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.534+0000 7f0759ffb640 1 -- 172.21.15.143:0/2072488021 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c00f730 con 0x7f0754004800 2024-05-08T10:24:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.534+0000 7f0759ffb640 1 -- 172.21.15.143:0/2072488021 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f075c018070 con 0x7f0754004800 2024-05-08T10:24:51.526 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.534+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07681e9460 con 0x7f0754004800 2024-05-08T10:24:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.534+0000 7f0759ffb640 1 -- 172.21.15.143:0/2072488021 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c00fb10 con 0x7f0754004800 2024-05-08T10:24:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.534+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07681e9a20 con 0x7f0754004800 2024-05-08T10:24:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.535+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076806a550 con 0x7f0754004800 2024-05-08T10:24:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.535+0000 7f0759ffb640 1 -- 172.21.15.143:0/2072488021 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f075c00fcb0 con 0x7f0754004800 2024-05-08T10:24:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.536+0000 7f0759ffb640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f074c0762d0 0x7f074c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.536+0000 7f076ce10640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f074c0762d0 0x7f074c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.527 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.536+0000 7f0759ffb640 1 -- 172.21.15.143:0/2072488021 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f075c0971f0 con 0x7f0754004800 2024-05-08T10:24:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.536+0000 7f076ce10640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f074c0762d0 0x7f074c078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0764032000 tx=0x7f076402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:51.528 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.540+0000 7f0759ffb640 1 -- 172.21.15.143:0/2072488021 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f075c060e50 con 0x7f0754004800 2024-05-08T10:24:51.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.718+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0768072da0 con 0x7f074c0762d0 2024-05-08T10:24:51.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.719+0000 7f0759ffb640 1 -- 172.21.15.143:0/2072488021 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13360 (secure 0 0 0) 0x7f0768072da0 con 0x7f074c0762d0 2024-05-08T10:24:51.705 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:51.705 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:51.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f074c0762d0 msgr2=0x7f074c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f074c0762d0 0x7f074c078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0764032000 tx=0x7f076402c000 comp rx=0 tx=0).stop 2024-05-08T10:24:51.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 msgr2=0x7f07681413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f07681413b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f075c004ef0 tx=0x7f075c007430 comp rx=0 tx=0).stop 2024-05-08T10:24:51.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 shutdown_connections 2024-05-08T10:24:51.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07680cefd0 0x7f07681ea6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f07680ceb90 0x7f07681ea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f074c0762d0 0x7f074c078790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 --2- 172.21.15.143:0/2072488021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754004800 0x7f07681413b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 >> 172.21.15.143:0/2072488021 conn(0x7f07680682f0 msgr2=0x7f0768162380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:51.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 shutdown_connections 2024-05-08T10:24:51.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.721+0000 7f076f875640 1 -- 172.21.15.143:0/2072488021 wait complete. 2024-05-08T10:24:51.717 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-08T10:24:50.535960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220224,"kb_used_data":4064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754496,"statfs":{"total":773094113280,"available":772868603904,"internally_reserved":0,"allocated":4161536,"data_stored":2331936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001463"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T10:24:42.716105+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:24:42.716105+0000","last_peered":"2024-05-08T10:24:42.716105+0000","last_clean":"2024-05-08T10:24:42.716105+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:42.716105+0000","last_undegraded":"2024-05-08T10:24:42.716105+0000","last_fullsized":"2024-05-08T10:24:42.716105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":730665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":154203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":154203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":730575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:51.718 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:24:51.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.832+0000 7facc382a640 1 Processor -- start 2024-05-08T10:24:51.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.832+0000 7facc382a640 1 -- start start 2024-05-08T10:24:51.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.833+0000 7facc382a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facbc0ae180 0x7facbc0d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.833+0000 7facc382a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facbc074830 con 0x7facbc15d130 2024-05-08T10:24:51.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.833+0000 7facc382a640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facbc073f90 con 0x7facbc0af310 2024-05-08T10:24:51.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.833+0000 7facc382a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7facbc074270 con 0x7facbc0ae180 2024-05-08T10:24:51.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.833+0000 7facc15c6640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7facbc15d130 0x7facbc0aec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52440/0 (socket says 172.21.15.143:52440) 2024-05-08T10:24:51.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.833+0000 7facc15c6640 1 -- 172.21.15.143:0/2885514623 learned_addr learned my addr 172.21.15.143:0/2885514623 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:51.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.833+0000 7facc1dc7640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facbc0ae180 0x7facbc0d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.833+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1406820691 0 0) 0x7facbc074830 con 0x7facbc15d130 2024-05-08T10:24:51.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.833+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faca8003520 con 0x7facbc15d130 2024-05-08T10:24:51.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134518418 0 0) 0x7facbc073f90 con 0x7facbc0af310 2024-05-08T10:24:51.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facbc074830 con 0x7facbc0af310 2024-05-08T10:24:51.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3983509666 0 0) 0x7faca8003520 con 0x7facbc15d130 2024-05-08T10:24:51.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facbc0ae180 msgr2=0x7facbc0d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:51.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facbc0ae180 0x7facbc0d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 >> v1:172.21.15.163:6789/0 conn(0x7facbc0af310 legacy=0x7facbc06edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facbc074550 con 0x7facbc15d130 2024-05-08T10:24:51.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7facb80016f0 con 0x7facbc15d130 2024-05-08T10:24:51.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 >> v1:172.21.15.143:6789/0 conn(0x7facbc15d130 legacy=0x7facbc0aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facbc0ae180 0x7faca8003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faca8004210 0x7faca8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faca8004d90 0x7faca8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7facbc074270 con 0x7faca8004210 2024-05-08T10:24:51.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7faca800bbd0 con 0x7faca8004d90 2024-05-08T10:24:51.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7faca800bdd0 con 0x7facbc0ae180 2024-05-08T10:24:51.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facc0dc5640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faca8004210 0x7faca8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facc15c6640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facbc0ae180 0x7faca8003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facc1dc7640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faca8004d90 0x7faca8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facc0dc5640 1 -- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facbc0ae180 msgr2=0x7faca8003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:51.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facc0dc5640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7facbc0ae180 0x7faca8003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facc0dc5640 1 -- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faca8004d90 msgr2=0x7faca8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:51.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facc0dc5640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faca8004d90 0x7faca8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.834+0000 7facc0dc5640 1 -- 172.21.15.143:0/2885514623 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca8003520 con 0x7faca8004210 2024-05-08T10:24:51.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.835+0000 7facc0dc5640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faca8004210 0x7faca8004800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7facac001900 tx=0x7faca8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78113a2d85c1dd0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:51.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.835+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac001520 con 0x7faca8004210 2024-05-08T10:24:51.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.835+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac02acd0 con 0x7faca8004210 2024-05-08T10:24:51.824 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.835+0000 7facb3fff640 1 -- 172.21.15.143:0/2885514623 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac005310 con 0x7faca8004210 2024-05-08T10:24:51.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.835+0000 7facc382a640 1 -- 172.21.15.143:0/2885514623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faca8004210 msgr2=0x7faca8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.835+0000 7facc382a640 1 --2- 172.21.15.143:0/2885514623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faca8004210 0x7faca8004800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7facac001900 tx=0x7faca8005830 comp rx=0 tx=0).stop 2024-05-08T10:24:51.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.835+0000 7facc1dc7640 1 -- 172.21.15.143:0/2885514623 reap_dead start 2024-05-08T10:24:51.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.836+0000 7facc382a640 1 -- 172.21.15.143:0/2885514623 shutdown_connections 2024-05-08T10:24:51.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.836+0000 7facc382a640 1 -- 172.21.15.143:0/2885514623 >> 172.21.15.143:0/2885514623 conn(0x7facbc06c500 msgr2=0x7facbc06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:51.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.836+0000 7facc382a640 1 -- 172.21.15.143:0/2885514623 shutdown_connections 2024-05-08T10:24:51.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.836+0000 7facc382a640 1 -- 172.21.15.143:0/2885514623 wait complete. 2024-05-08T10:24:51.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.837+0000 7facc382a640 1 Processor -- start 2024-05-08T10:24:51.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.837+0000 7facc382a640 1 -- start start 2024-05-08T10:24:51.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc382a640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faca8004210 0x7facbc09c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc382a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facbc09bfc0 0x7facbc146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc382a640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facbc1e5ba0 0x7facbc15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc382a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7facbc0d08a0 con 0x7facbc09bfc0 2024-05-08T10:24:51.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc382a640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7facbc0d0720 con 0x7facbc1e5ba0 2024-05-08T10:24:51.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc382a640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7facbc0d0a20 con 0x7faca8004210 2024-05-08T10:24:51.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc0dc5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facbc09bfc0 0x7facbc146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc0dc5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facbc09bfc0 0x7facbc146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55122/0 (socket says 172.21.15.143:55122) 2024-05-08T10:24:51.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc0dc5640 1 -- 172.21.15.143:0/2359518223 learned_addr learned my addr 172.21.15.143:0/2359518223 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:51.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc1dc7640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facbc1e5ba0 0x7facbc15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc15c6640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faca8004210 0x7facbc09c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc0dc5640 1 -- 172.21.15.143:0/2359518223 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faca8004210 msgr2=0x7facbc09c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc0dc5640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faca8004210 0x7facbc09c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc0dc5640 1 -- 172.21.15.143:0/2359518223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facbc1e5ba0 msgr2=0x7facbc15e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:51.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc0dc5640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facbc1e5ba0 0x7facbc15e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:51.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc0dc5640 1 -- 172.21.15.143:0/2359518223 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facbc146d90 con 0x7facbc09bfc0 2024-05-08T10:24:51.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc0dc5640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facbc09bfc0 0x7facbc146530 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7facac005040 tx=0x7facac0012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:51.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facb1ffb640 1 -- 172.21.15.143:0/2359518223 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac001520 con 0x7facbc09bfc0 2024-05-08T10:24:51.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facb1ffb640 1 -- 172.21.15.143:0/2359518223 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac0075e0 con 0x7facbc09bfc0 2024-05-08T10:24:51.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facbc147070 con 0x7facbc09bfc0 2024-05-08T10:24:51.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.838+0000 7facb1ffb640 1 -- 172.21.15.143:0/2359518223 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac0069d0 con 0x7facbc09bfc0 2024-05-08T10:24:51.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.839+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facbc147630 con 0x7facbc09bfc0 2024-05-08T10:24:51.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.839+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facbc06a550 con 0x7facbc09bfc0 2024-05-08T10:24:51.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.840+0000 7facb1ffb640 1 -- 172.21.15.143:0/2359518223 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7facac006b70 con 0x7facbc09bfc0 2024-05-08T10:24:51.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.841+0000 7facb1ffb640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faca00762d0 0x7faca0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:51.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.841+0000 7facb1ffb640 1 -- 172.21.15.143:0/2359518223 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7facac0b6860 con 0x7facbc09bfc0 2024-05-08T10:24:51.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.841+0000 7facc15c6640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faca00762d0 0x7faca0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:51.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.841+0000 7facc15c6640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faca00762d0 0x7faca0078790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facb8001220 tx=0x7facb80011b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:51.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:51.845+0000 7facb1ffb640 1 -- 172.21.15.143:0/2359518223 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7facac07ff50 con 0x7facbc09bfc0 2024-05-08T10:24:52.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.025+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facbc070800 con 0x7facbc09bfc0 2024-05-08T10:24:52.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.026+0000 7facb1ffb640 1 -- 172.21.15.143:0/2359518223 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+13058 (secure 0 0 0) 0x7facac084250 con 0x7facbc09bfc0 2024-05-08T10:24:52.011 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:52.012 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":34,"fsid":"aa0e1c9f-61b7-4a5c-bf5a-004dcc476c64","created":"2024-05-08T10:23:32.147622+0000","modified":"2024-05-08T10:24:48.629378+0000","last_up_change":"2024-05-08T10:23:42.147623+0000","last_in_change":"2024-05-08T10:23:34.312126+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:23:42.539787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8052b6c-3142-430e-8d27-06812219f3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6801","nonce":2747905564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6803","nonce":2747905564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6807","nonce":2747905564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":2747905564},{"type":"v1","addr":"172.21.15.143:6805","nonce":2747905564}]},"public_addr":"172.21.15.143:6801/2747905564","cluster_addr":"172.21.15.143:6803/2747905564","heartbeat_back_addr":"172.21.15.143:6807/2747905564","heartbeat_front_addr":"172.21.15.143:6805/2747905564","state":["exists","up"]},{"osd":1,"uuid":"ceaa1aba-2365-471d-b793-c9f2f75a9c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6817","nonce":671471033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6819","nonce":671471033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6823","nonce":671471033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":671471033},{"type":"v1","addr":"172.21.15.143:6821","nonce":671471033}]},"public_addr":"172.21.15.143:6817/671471033","cluster_addr":"172.21.15.143:6819/671471033","heartbeat_back_addr":"172.21.15.143:6823/671471033","heartbeat_front_addr":"172.21.15.143:6821/671471033","state":["exists","up"]},{"osd":2,"uuid":"b2f8c715-7480-433e-bfbb-96753e0b6470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6809","nonce":2912298193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6811","nonce":2912298193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6815","nonce":2912298193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":2912298193},{"type":"v1","addr":"172.21.15.143:6813","nonce":2912298193}]},"public_addr":"172.21.15.143:6809/2912298193","cluster_addr":"172.21.15.143:6811/2912298193","heartbeat_back_addr":"172.21.15.143:6815/2912298193","heartbeat_front_addr":"172.21.15.143:6813/2912298193","state":["exists","up"]},{"osd":3,"uuid":"93369408-21e3-4ec5-9166-0f775990cf78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6825","nonce":2042563744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6827","nonce":2042563744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6831","nonce":2042563744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2042563744},{"type":"v1","addr":"172.21.15.143:6829","nonce":2042563744}]},"public_addr":"172.21.15.143:6825/2042563744","cluster_addr":"172.21.15.143:6827/2042563744","heartbeat_back_addr":"172.21.15.143:6831/2042563744","heartbeat_front_addr":"172.21.15.143:6829/2042563744","state":["exists","up"]},{"osd":4,"uuid":"7e555f1e-80d2-4b01-a986-b86f40c1cfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6809","nonce":4191344201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6811","nonce":4191344201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6815","nonce":4191344201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":4191344201},{"type":"v1","addr":"172.21.15.163:6813","nonce":4191344201}]},"public_addr":"172.21.15.163:6809/4191344201","cluster_addr":"172.21.15.163:6811/4191344201","heartbeat_back_addr":"172.21.15.163:6815/4191344201","heartbeat_front_addr":"172.21.15.163:6813/4191344201","state":["exists","up"]},{"osd":5,"uuid":"7c5e74ef-bc54-4ad8-951f-ff503fb0241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6801","nonce":688232145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6803","nonce":688232145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6807","nonce":688232145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":688232145},{"type":"v1","addr":"172.21.15.163:6805","nonce":688232145}]},"public_addr":"172.21.15.163:6801/688232145","cluster_addr":"172.21.15.163:6803/688232145","heartbeat_back_addr":"172.21.15.163:6807/688232145","heartbeat_front_addr":"172.21.15.163:6805/688232145","state":["exists","up"]},{"osd":6,"uuid":"c6fdee42-f63f-4b77-ba34-0c148cc4075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6825","nonce":2263704478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6827","nonce":2263704478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6831","nonce":2263704478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2263704478},{"type":"v1","addr":"172.21.15.163:6829","nonce":2263704478}]},"public_addr":"172.21.15.163:6825/2263704478","cluster_addr":"172.21.15.163:6827/2263704478","heartbeat_back_addr":"172.21.15.163:6831/2263704478","heartbeat_front_addr":"172.21.15.163:6829/2263704478","state":["exists","up"]},{"osd":7,"uuid":"23536821-eb72-4083-a0ce-7ebefa5d7403","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6817","nonce":4102156474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6819","nonce":4102156474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6823","nonce":4102156474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":4102156474},{"type":"v1","addr":"172.21.15.163:6821","nonce":4102156474}]},"public_addr":"172.21.15.163:6817/4102156474","cluster_addr":"172.21.15.163:6819/4102156474","heartbeat_back_addr":"172.21.15.163:6823/4102156474","heartbeat_front_addr":"172.21.15.163:6821/4102156474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.429931+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.491828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.525921+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.470368+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.463853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.431816+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.460480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:23:39.447287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3656674830":"2024-05-09T10:24:41.751187+0000","172.21.15.143:6835/3656674830":"2024-05-09T10:24:41.751187+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:24:52.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faca00762d0 msgr2=0x7faca0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:52.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faca00762d0 0x7faca0078790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facb8001220 tx=0x7facb80011b0 comp rx=0 tx=0).stop 2024-05-08T10:24:52.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facbc09bfc0 msgr2=0x7facbc146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:52.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facbc09bfc0 0x7facbc146530 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7facac005040 tx=0x7facac0012f0 comp rx=0 tx=0).stop 2024-05-08T10:24:52.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 shutdown_connections 2024-05-08T10:24:52.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facbc1e5ba0 0x7facbc15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:52.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7faca00762d0 0x7faca0078790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:52.014 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facbc09bfc0 0x7facbc146530 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:52.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 --2- 172.21.15.143:0/2359518223 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faca8004210 0x7facbc09c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:52.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.028+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 >> 172.21.15.143:0/2359518223 conn(0x7facbc06c500 msgr2=0x7facbc0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:52.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.029+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 shutdown_connections 2024-05-08T10:24:52.015 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:52.029+0000 7facc382a640 1 -- 172.21.15.143:0/2359518223 wait complete. 2024-05-08T10:24:53.025 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T10:24:53.026 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:24:53.138 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.153+0000 7f3f8dd24640 1 Processor -- start 2024-05-08T10:24:53.139 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.153+0000 7f3f8dd24640 1 -- start start 2024-05-08T10:24:53.140 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.154+0000 7f3f8dd24640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f881578e0 0x7f3f8815e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.154+0000 7f3f8dd24640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3f880b4e60 0x7f3f880afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.154+0000 7f3f8dd24640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8815e700 con 0x7f3f880b52a0 2024-05-08T10:24:53.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.154+0000 7f3f8dd24640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f3f880b4410 con 0x7f3f880b4e60 2024-05-08T10:24:53.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.154+0000 7f3f8dd24640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3f880ae160 con 0x7f3f881578e0 2024-05-08T10:24:53.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f86ffd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3f880b4e60 0x7f3f880afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f86ffd640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3f880b4e60 0x7f3f880afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:47958/0 (socket says 172.21.15.143:47958) 2024-05-08T10:24:53.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f877fe640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f881578e0 0x7f3f8815e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.141 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f87fff640 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f3f880b52a0 0x7f3f8806e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:37142/0 (socket says 172.21.15.143:37142) 2024-05-08T10:24:53.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f86ffd640 1 -- 172.21.15.143:0/1885011890 learned_addr learned my addr 172.21.15.143:0/1885011890 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:53.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f867fc640 1 -- 172.21.15.143:0/1885011890 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902140849 0 0) 0x7f3f80001110 con 0x7f3f880b52a0 2024-05-08T10:24:53.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f867fc640 1 -- 172.21.15.143:0/1885011890 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f70003520 con 0x7f3f880b52a0 2024-05-08T10:24:53.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f877fe640 1 -- 172.21.15.143:0/1885011890 >> v2:172.21.15.163:3300/0 conn(0x7f3f880b4e60 msgr2=0x7f3f880afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:53.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f877fe640 1 --2- 172.21.15.143:0/1885011890 >> v2:172.21.15.163:3300/0 conn(0x7f3f880b4e60 0x7f3f880afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f877fe640 1 -- 172.21.15.143:0/1885011890 >> v1:172.21.15.163:6789/0 conn(0x7f3f880b52a0 legacy=0x7f3f8806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.155+0000 7f3f877fe640 1 -- 172.21.15.143:0/1885011890 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f880ae420 con 0x7f3f881578e0 2024-05-08T10:24:53.142 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.156+0000 7f3f877fe640 1 --2- 172.21.15.143:0/1885011890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f881578e0 0x7f3f8815e1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009d90 tx=0x7f3f7802a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=678bf6b68db666b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.156+0000 7f3f867fc640 1 -- 172.21.15.143:0/1885011890 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78007740 con 0x7f3f881578e0 2024-05-08T10:24:53.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.156+0000 7f3f867fc640 1 -- 172.21.15.143:0/1885011890 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f780078e0 con 0x7f3f881578e0 2024-05-08T10:24:53.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.156+0000 7f3f867fc640 1 -- 172.21.15.143:0/1885011890 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78007c90 con 0x7f3f881578e0 2024-05-08T10:24:53.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.157+0000 7f3f8dd24640 1 -- 172.21.15.143:0/1885011890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f881578e0 msgr2=0x7f3f8815e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.146 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.157+0000 7f3f8dd24640 1 --2- 172.21.15.143:0/1885011890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f881578e0 0x7f3f8815e1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009d90 tx=0x7f3f7802a530 comp rx=0 tx=0).stop 2024-05-08T10:24:53.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.157+0000 7f3f8dd24640 1 -- 172.21.15.143:0/1885011890 shutdown_connections 2024-05-08T10:24:53.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.157+0000 7f3f8dd24640 1 --2- 172.21.15.143:0/1885011890 >> v2:172.21.15.163:3300/0 conn(0x7f3f880b4e60 0x7f3f880afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.157+0000 7f3f8dd24640 1 --2- 172.21.15.143:0/1885011890 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f881578e0 0x7f3f8815e1c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.157+0000 7f3f8dd24640 1 -- 172.21.15.143:0/1885011890 >> 172.21.15.143:0/1885011890 conn(0x7f3f880b2b40 msgr2=0x7f3f880b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:53.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.157+0000 7f3f8dd24640 1 -- 172.21.15.143:0/1885011890 shutdown_connections 2024-05-08T10:24:53.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.157+0000 7f3f8dd24640 1 -- 172.21.15.143:0/1885011890 wait complete. 2024-05-08T10:24:53.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.158+0000 7f3f8dd24640 1 Processor -- start 2024-05-08T10:24:53.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.158+0000 7f3f8dd24640 1 -- start start 2024-05-08T10:24:53.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f8dd24640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f880b4e60 0x7f3f88155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f8dd24640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f881578e0 0x7f3f88072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f8dd24640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f880c66c0 0x7f3f880b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f8dd24640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3f880ade20 con 0x7f3f880b4e60 2024-05-08T10:24:53.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f8dd24640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3f880b4940 con 0x7f3f881578e0 2024-05-08T10:24:53.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f8dd24640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f3f880b6260 con 0x7f3f880c66c0 2024-05-08T10:24:53.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f877fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f880b4e60 0x7f3f88155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f877fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f880b4e60 0x7f3f88155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55124/0 (socket says 172.21.15.143:55124) 2024-05-08T10:24:53.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f877fe640 1 -- 172.21.15.143:0/4238505424 learned_addr learned my addr 172.21.15.143:0/4238505424 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:53.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f87fff640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f880c66c0 0x7f3f880b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f86ffd640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f881578e0 0x7f3f88072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f877fe640 1 -- 172.21.15.143:0/4238505424 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f880c66c0 msgr2=0x7f3f880b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f877fe640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f880c66c0 0x7f3f880b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f877fe640 1 -- 172.21.15.143:0/4238505424 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f881578e0 msgr2=0x7f3f88072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f877fe640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f881578e0 0x7f3f88072d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.149 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f877fe640 1 -- 172.21.15.143:0/4238505424 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f88073620 con 0x7f3f880b4e60 2024-05-08T10:24:53.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.159+0000 7f3f87fff640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3f880c66c0 0x7f3f880b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:53.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.160+0000 7f3f877fe640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f880b4e60 0x7f3f88155bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3f78000f80 tx=0x7f3f78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.160+0000 7f3f6ffff640 1 -- 172.21.15.143:0/4238505424 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7803f070 con 0x7f3f880b4e60 2024-05-08T10:24:53.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.160+0000 7f3f6ffff640 1 -- 172.21.15.143:0/4238505424 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f78031c40 con 0x7f3f880b4e60 2024-05-08T10:24:53.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.160+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f88073900 con 0x7f3f880b4e60 2024-05-08T10:24:53.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.160+0000 7f3f6ffff640 1 -- 172.21.15.143:0/4238505424 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78009450 con 0x7f3f880b4e60 2024-05-08T10:24:53.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.160+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f88073ec0 con 0x7f3f880b4e60 2024-05-08T10:24:53.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.160+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f8806a550 con 0x7f3f880b4e60 2024-05-08T10:24:53.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.161+0000 7f3f6ffff640 1 -- 172.21.15.143:0/4238505424 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f78003990 con 0x7f3f880b4e60 2024-05-08T10:24:53.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.162+0000 7f3f6ffff640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f740762d0 0x7f3f74078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.162+0000 7f3f6ffff640 1 -- 172.21.15.143:0/4238505424 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f3f780b8460 con 0x7f3f880b4e60 2024-05-08T10:24:53.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.162+0000 7f3f86ffd640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f740762d0 0x7f3f74078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.162+0000 7f3f6ffff640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7f3f7407c190 0x7f3f7407e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.162+0000 7f3f6ffff640 1 -- 172.21.15.143:0/4238505424 --> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f780091a0 con 0x7f3f7407c190 2024-05-08T10:24:53.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.162+0000 7f3f6ffff640 1 -- 172.21.15.143:0/4238505424 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3f780bf050 con 0x7f3f880b4e60 2024-05-08T10:24:53.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.162+0000 7f3f87fff640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7f3f7407c190 0x7f3f7407e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.162+0000 7f3f86ffd640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f740762d0 0x7f3f74078790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f880b3730 tx=0x7f3f7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.162+0000 7f3f87fff640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7f3f7407c190 0x7f3f7407e5b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.153 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.163+0000 7f3f6ffff640 1 -- 172.21.15.143:0/4238505424 <== osd.0 v2:172.21.15.143:6800/2747905564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f780091a0 con 0x7f3f7407c190 2024-05-08T10:24:53.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.176+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 --> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3f8806fec0 con 0x7f3f7407c190 2024-05-08T10:24:53.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.176+0000 7f3f6ffff640 1 -- 172.21.15.143:0/4238505424 <== osd.0 v2:172.21.15.143:6800/2747905564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3f8806fec0 con 0x7f3f7407c190 2024-05-08T10:24:53.162 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:53.162 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:24:53.162 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:53.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.176+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7f3f7407c190 msgr2=0x7f3f7407e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.176+0000 7f3f8dd24640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6800/2747905564,v1:172.21.15.143:6801/2747905564] conn(0x7f3f7407c190 0x7f3f7407e5b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.176+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f740762d0 msgr2=0x7f3f74078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.176+0000 7f3f8dd24640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f3f740762d0 0x7f3f74078790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f880b3730 tx=0x7f3f7c008040 comp rx=0 tx=0).stop 2024-05-08T10:24:53.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.176+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f880b4e60 msgr2=0x7f3f88155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.176+0000 7f3f8dd24640 1 --2- 172.21.15.143:0/4238505424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f880b4e60 0x7f3f88155bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3f78000f80 tx=0x7f3f78004a40 comp rx=0 tx=0).stop 2024-05-08T10:24:53.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.177+0000 7f3f87fff640 1 -- 172.21.15.143:0/4238505424 reap_dead start 2024-05-08T10:24:53.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.177+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 shutdown_connections 2024-05-08T10:24:53.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.177+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 >> 172.21.15.143:0/4238505424 conn(0x7f3f880b2b40 msgr2=0x7f3f88160b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:53.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.177+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 shutdown_connections 2024-05-08T10:24:53.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.177+0000 7f3f8dd24640 1 -- 172.21.15.143:0/4238505424 wait complete. 2024-05-08T10:24:53.172 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T10:24:53.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.287+0000 7ff3a3778640 1 Processor -- start 2024-05-08T10:24:53.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.287+0000 7ff3a3778640 1 -- start start 2024-05-08T10:24:53.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a3778640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff39c0b8240 0x7ff39c0d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a3778640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c0b8a60 con 0x7ff39c0d2250 2024-05-08T10:24:53.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a3778640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c0b8d40 con 0x7ff39c15f350 2024-05-08T10:24:53.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a3778640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff39c0b9670 con 0x7ff39c0b8240 2024-05-08T10:24:53.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a0d13640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff39c0b8240 0x7ff39c0d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a1d15640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff39c0d2250 0x7ff39c0b9b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:52452/0 (socket says 172.21.15.143:52452) 2024-05-08T10:24:53.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a0d13640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff39c0b8240 0x7ff39c0d3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55126/0 (socket says 172.21.15.143:55126) 2024-05-08T10:24:53.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a1d15640 1 -- 172.21.15.143:0/2541021561 learned_addr learned my addr 172.21.15.143:0/2541021561 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:53.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a0d13640 1 -- 172.21.15.143:0/2541021561 >> v1:172.21.15.163:6789/0 conn(0x7ff39c15f350 legacy=0x7ff39c0bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a0d13640 1 -- 172.21.15.143:0/2541021561 >> v1:172.21.15.143:6789/0 conn(0x7ff39c0d2250 legacy=0x7ff39c0b9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.288+0000 7ff3a0d13640 1 -- 172.21.15.143:0/2541021561 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c0b9020 con 0x7ff39c0b8240 2024-05-08T10:24:53.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.289+0000 7ff3a0d13640 1 --2- 172.21.15.143:0/2541021561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c0b8240 0x7ff39c0d3580 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0097a0 tx=0x7ff38c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560c61113543b15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.289+0000 7ff393fff640 1 -- 172.21.15.143:0/2541021561 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c037070 con 0x7ff39c0b8240 2024-05-08T10:24:53.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.289+0000 7ff393fff640 1 -- 172.21.15.143:0/2541021561 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c032640 con 0x7ff39c0b8240 2024-05-08T10:24:53.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.289+0000 7ff393fff640 1 -- 172.21.15.143:0/2541021561 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c032a10 con 0x7ff39c0b8240 2024-05-08T10:24:53.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.289+0000 7ff3a3778640 1 -- 172.21.15.143:0/2541021561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c0b8240 msgr2=0x7ff39c0d3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.289+0000 7ff3a3778640 1 --2- 172.21.15.143:0/2541021561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c0b8240 0x7ff39c0d3580 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0097a0 tx=0x7ff38c02a2c0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.290+0000 7ff3a3778640 1 -- 172.21.15.143:0/2541021561 shutdown_connections 2024-05-08T10:24:53.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.290+0000 7ff3a3778640 1 --2- 172.21.15.143:0/2541021561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c0b8240 0x7ff39c0d3580 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.290+0000 7ff3a3778640 1 -- 172.21.15.143:0/2541021561 >> 172.21.15.143:0/2541021561 conn(0x7ff39c073e70 msgr2=0x7ff39c074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:53.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.290+0000 7ff3a3778640 1 -- 172.21.15.143:0/2541021561 shutdown_connections 2024-05-08T10:24:53.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.290+0000 7ff3a3778640 1 -- 172.21.15.143:0/2541021561 wait complete. 2024-05-08T10:24:53.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.291+0000 7ff3a3778640 1 Processor -- start 2024-05-08T10:24:53.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.291+0000 7ff3a3778640 1 -- start start 2024-05-08T10:24:53.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.291+0000 7ff3a3778640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39c0b8240 0x7ff39c161d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.291+0000 7ff3a3778640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff39c0d2250 0x7ff39c15f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.291+0000 7ff3a3778640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c15f350 0x7ff39c15fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.291+0000 7ff3a3778640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c15f730 con 0x7ff39c15f350 2024-05-08T10:24:53.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.291+0000 7ff3a3778640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0d3ac0 con 0x7ff39c0b8240 2024-05-08T10:24:53.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.291+0000 7ff3a3778640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c0b86a0 con 0x7ff39c0d2250 2024-05-08T10:24:53.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1d15640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c15f350 0x7ff39c15fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1d15640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c15f350 0x7ff39c15fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:55130/0 (socket says 172.21.15.143:55130) 2024-05-08T10:24:53.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1d15640 1 -- 172.21.15.143:0/2082740123 learned_addr learned my addr 172.21.15.143:0/2082740123 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:53.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1514640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39c0b8240 0x7ff39c161d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a0d13640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff39c0d2250 0x7ff39c15f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1d15640 1 -- 172.21.15.143:0/2082740123 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff39c0d2250 msgr2=0x7ff39c15f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.282 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1d15640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff39c0d2250 0x7ff39c15f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1d15640 1 -- 172.21.15.143:0/2082740123 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39c0b8240 msgr2=0x7ff39c161d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1d15640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39c0b8240 0x7ff39c161d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1d15640 1 -- 172.21.15.143:0/2082740123 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c1605e0 con 0x7ff39c15f350 2024-05-08T10:24:53.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1514640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39c0b8240 0x7ff39c161d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:53.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a1d15640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c15f350 0x7ff39c15fe80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff39400cb50 tx=0x7ff39400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff391ffb640 1 -- 172.21.15.143:0/2082740123 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394017070 con 0x7ff39c15f350 2024-05-08T10:24:53.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff391ffb640 1 -- 172.21.15.143:0/2082740123 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39400ad40 con 0x7ff39c15f350 2024-05-08T10:24:53.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c1608c0 con 0x7ff39c15f350 2024-05-08T10:24:53.283 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff391ffb640 1 -- 172.21.15.143:0/2082740123 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394012600 con 0x7ff39c15f350 2024-05-08T10:24:53.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.292+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c160e80 con 0x7ff39c15f350 2024-05-08T10:24:53.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.293+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39c06a4b0 con 0x7ff39c15f350 2024-05-08T10:24:53.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.294+0000 7ff391ffb640 1 -- 172.21.15.143:0/2082740123 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff39401a070 con 0x7ff39c15f350 2024-05-08T10:24:53.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.295+0000 7ff391ffb640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3800762d0 0x7ff380078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.295+0000 7ff3a1514640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3800762d0 0x7ff380078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.295+0000 7ff391ffb640 1 -- 172.21.15.143:0/2082740123 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7ff394096f80 con 0x7ff39c15f350 2024-05-08T10:24:53.284 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.295+0000 7ff3a1514640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3800762d0 0x7ff380078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff398007fd0 tx=0x7ff398009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.285 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.299+0000 7ff391ffb640 1 -- 172.21.15.143:0/2082740123 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff394060620 con 0x7ff39c15f350 2024-05-08T10:24:53.468 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.483+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff39c0b4610 con 0x7ff3800762d0 2024-05-08T10:24:53.469 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.484+0000 7ff391ffb640 1 -- 172.21.15.143:0/2082740123 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff39c0b4610 con 0x7ff3800762d0 2024-05-08T10:24:53.469 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T10:24:53.471 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3800762d0 msgr2=0x7ff380078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3800762d0 0x7ff380078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff398007fd0 tx=0x7ff398009040 comp rx=0 tx=0).stop 2024-05-08T10:24:53.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c15f350 msgr2=0x7ff39c15fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c15f350 0x7ff39c15fe80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff39400cb50 tx=0x7ff39400a430 comp rx=0 tx=0).stop 2024-05-08T10:24:53.472 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 shutdown_connections 2024-05-08T10:24:53.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7ff3800762d0 0x7ff380078790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff39c15f350 0x7ff39c15fe80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff39c0d2250 0x7ff39c15f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 --2- 172.21.15.143:0/2082740123 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff39c0b8240 0x7ff39c161d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 >> 172.21.15.143:0/2082740123 conn(0x7ff39c073e70 msgr2=0x7ff39c0d3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:53.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 shutdown_connections 2024-05-08T10:24:53.473 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.486+0000 7ff3a3778640 1 -- 172.21.15.143:0/2082740123 wait complete. 2024-05-08T10:24:53.482 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T10:24:53.482 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:24:53.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.601+0000 7f56d2b71640 1 Processor -- start 2024-05-08T10:24:53.586 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.601+0000 7f56d2b71640 1 -- start start 2024-05-08T10:24:53.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56d2b71640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f56cc0b7380 0x7f56cc06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56d2b71640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56cc06fe60 con 0x7f56cc1608b0 2024-05-08T10:24:53.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56d2b71640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56cc0cf850 con 0x7f56cc068110 2024-05-08T10:24:53.588 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56d2b71640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f56cc06c320 con 0x7f56cc0b7380 2024-05-08T10:24:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56cbfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f56cc0b7380 0x7f56cc06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56d090d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f56cc1608b0 0x7f56cc0b6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54226/0 (socket says 172.21.15.143:54226) 2024-05-08T10:24:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56cbfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f56cc0b7380 0x7f56cc06c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39398/0 (socket says 172.21.15.143:39398) 2024-05-08T10:24:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56d090d640 1 -- 172.21.15.143:0/3858305845 learned_addr learned my addr 172.21.15.143:0/3858305845 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56cbfff640 1 -- 172.21.15.143:0/3858305845 >> v1:172.21.15.163:6789/0 conn(0x7f56cc068110 legacy=0x7f56cc06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56cb7fe640 1 -- 172.21.15.143:0/3858305845 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769356741 0 0) 0x7f56cc06fe60 con 0x7f56cc1608b0 2024-05-08T10:24:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56cbfff640 1 -- 172.21.15.143:0/3858305845 >> v1:172.21.15.143:6789/0 conn(0x7f56cc1608b0 legacy=0x7f56cc0b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.602+0000 7f56cbfff640 1 -- 172.21.15.143:0/3858305845 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc0cfb30 con 0x7f56cc0b7380 2024-05-08T10:24:53.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.603+0000 7f56cbfff640 1 --2- 172.21.15.143:0/3858305845 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 0x7f56cc06c7b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f56cc06c4a0 tx=0x7f56c002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32447c8f938a26d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.603+0000 7f56cb7fe640 1 -- 172.21.15.143:0/3858305845 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0037070 con 0x7f56cc0b7380 2024-05-08T10:24:53.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.603+0000 7f56cb7fe640 1 -- 172.21.15.143:0/3858305845 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c002ae50 con 0x7f56cc0b7380 2024-05-08T10:24:53.590 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.603+0000 7f56cb7fe640 1 -- 172.21.15.143:0/3858305845 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0032660 con 0x7f56cc0b7380 2024-05-08T10:24:53.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.604+0000 7f56d2b71640 1 -- 172.21.15.143:0/3858305845 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 msgr2=0x7f56cc06c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.604+0000 7f56d2b71640 1 --2- 172.21.15.143:0/3858305845 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 0x7f56cc06c7b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f56cc06c4a0 tx=0x7f56c002a100 comp rx=0 tx=0).stop 2024-05-08T10:24:53.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.604+0000 7f56d2b71640 1 -- 172.21.15.143:0/3858305845 shutdown_connections 2024-05-08T10:24:53.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.604+0000 7f56d2b71640 1 --2- 172.21.15.143:0/3858305845 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 0x7f56cc06c7b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.604+0000 7f56d2b71640 1 -- 172.21.15.143:0/3858305845 >> 172.21.15.143:0/3858305845 conn(0x7f56cc0cf2a0 msgr2=0x7f56cc072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:53.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.604+0000 7f56d2b71640 1 -- 172.21.15.143:0/3858305845 shutdown_connections 2024-05-08T10:24:53.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.604+0000 7f56d2b71640 1 -- 172.21.15.143:0/3858305845 wait complete. 2024-05-08T10:24:53.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.605+0000 7f56d2b71640 1 Processor -- start 2024-05-08T10:24:53.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.605+0000 7f56d2b71640 1 -- start start 2024-05-08T10:24:53.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56d2b71640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f56cc068110 0x7f56cc0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.595 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56d2b71640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 0x7f56cc151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56d2b71640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56cc1608b0 0x7f56cc158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56d2b71640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc0b1160 con 0x7f56cc0b7380 2024-05-08T10:24:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56d2b71640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc0b0fe0 con 0x7f56cc1608b0 2024-05-08T10:24:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56d2b71640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f56cc06f8b0 con 0x7f56cc068110 2024-05-08T10:24:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56cbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 0x7f56cc151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56cbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 0x7f56cc151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39406/0 (socket says 172.21.15.143:39406) 2024-05-08T10:24:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56cbfff640 1 -- 172.21.15.143:0/1774994855 learned_addr learned my addr 172.21.15.143:0/1774994855 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:53.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56cbfff640 1 -- 172.21.15.143:0/1774994855 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f56cc068110 msgr2=0x7f56cc0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56cbfff640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f56cc068110 0x7f56cc0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56cbfff640 1 -- 172.21.15.143:0/1774994855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56cc1608b0 msgr2=0x7f56cc158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56d110e640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56cc1608b0 0x7f56cc158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56cbfff640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56cc1608b0 0x7f56cc158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.606+0000 7f56cbfff640 1 -- 172.21.15.143:0/1774994855 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc0aef60 con 0x7f56cc0b7380 2024-05-08T10:24:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.607+0000 7f56cbfff640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 0x7f56cc151060 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009890 tx=0x7f56c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.607+0000 7f56c97fa640 1 -- 172.21.15.143:0/1774994855 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0037040 con 0x7f56cc0b7380 2024-05-08T10:24:53.597 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.607+0000 7f56c97fa640 1 -- 172.21.15.143:0/1774994855 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c0004030 con 0x7f56cc0b7380 2024-05-08T10:24:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.607+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56cc0af240 con 0x7f56cc0b7380 2024-05-08T10:24:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.607+0000 7f56c97fa640 1 -- 172.21.15.143:0/1774994855 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0006e10 con 0x7f56cc0b7380 2024-05-08T10:24:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.607+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56cc0af800 con 0x7f56cc0b7380 2024-05-08T10:24:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.608+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56cc151a10 con 0x7f56cc0b7380 2024-05-08T10:24:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.608+0000 7f56c97fa640 1 -- 172.21.15.143:0/1774994855 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f56c003d650 con 0x7f56cc0b7380 2024-05-08T10:24:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.609+0000 7f56c97fa640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f56b80762d0 0x7f56b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.609+0000 7f56c97fa640 1 -- 172.21.15.143:0/1774994855 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f56c00b7ba0 con 0x7f56cc0b7380 2024-05-08T10:24:53.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.609+0000 7f56d090d640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f56b80762d0 0x7f56b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.609+0000 7f56c97fa640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f56b807c190 0x7f56b807e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.609+0000 7f56c97fa640 1 -- 172.21.15.143:0/1774994855 --> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56c003be50 con 0x7f56b807c190 2024-05-08T10:24:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.609+0000 7f56c97fa640 1 -- 172.21.15.143:0/1774994855 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f56c00bc2c0 con 0x7f56cc0b7380 2024-05-08T10:24:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.609+0000 7f56d110e640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f56b807c190 0x7f56b807e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.609+0000 7f56d090d640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f56b80762d0 0x7f56b8078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f56bc007fd0 tx=0x7f56bc007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.609+0000 7f56d110e640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f56b807c190 0x7f56b807e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.610+0000 7f56c97fa640 1 -- 172.21.15.143:0/1774994855 <== osd.1 v2:172.21.15.143:6816/671471033 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f56c003be50 con 0x7f56b807c190 2024-05-08T10:24:53.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.623+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 --> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f56cc06a550 con 0x7f56b807c190 2024-05-08T10:24:53.608 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.623+0000 7f56c97fa640 1 -- 172.21.15.143:0/1774994855 <== osd.1 v2:172.21.15.143:6816/671471033 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f56cc06a550 con 0x7f56b807c190 2024-05-08T10:24:53.608 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:53.609 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:24:53.609 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:53.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.623+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f56b807c190 msgr2=0x7f56b807e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d2b71640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6816/671471033,v1:172.21.15.143:6817/671471033] conn(0x7f56b807c190 0x7f56b807e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f56b80762d0 msgr2=0x7f56b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d2b71640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f56b80762d0 0x7f56b8078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f56bc007fd0 tx=0x7f56bc007960 comp rx=0 tx=0).stop 2024-05-08T10:24:53.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 msgr2=0x7f56cc151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d2b71640 1 --2- 172.21.15.143:0/1774994855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56cc0b7380 0x7f56cc151060 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009890 tx=0x7f56c00046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d110e640 1 -- 172.21.15.143:0/1774994855 reap_dead start 2024-05-08T10:24:53.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 shutdown_connections 2024-05-08T10:24:53.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 >> 172.21.15.143:0/1774994855 conn(0x7f56cc0cf2a0 msgr2=0x7f56cc0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:53.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 shutdown_connections 2024-05-08T10:24:53.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.624+0000 7f56d2b71640 1 -- 172.21.15.143:0/1774994855 wait complete. 2024-05-08T10:24:53.619 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T10:24:53.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.736+0000 7f9de2eda640 1 Processor -- start 2024-05-08T10:24:53.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.736+0000 7f9de2eda640 1 -- start start 2024-05-08T10:24:53.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9de2eda640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 0x7f9ddc0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9de2eda640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ddc072900 0x7f9ddc0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9de2eda640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9ddc0b03b0 0x7f9ddc0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9de2eda640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9ddc0af9e0 con 0x7f9ddc072900 2024-05-08T10:24:53.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9de2eda640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f9ddc0aeb30 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9de2eda640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc0aedd0 con 0x7f9ddc144ce0 2024-05-08T10:24:53.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9ddbfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ddc072900 0x7f9ddc0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9ddbfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9ddc072900 0x7f9ddc0afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39408/0 (socket says 172.21.15.143:39408) 2024-05-08T10:24:53.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9ddbfff640 1 -- 172.21.15.143:0/3723574660 learned_addr learned my addr 172.21.15.143:0/3723574660 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:53.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9de1477640 1 --2- 172.21.15.143:0/3723574660 >> v2:172.21.15.163:3300/0 conn(0x7f9ddc0b03b0 0x7f9ddc0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9de0c76640 1 --2- 172.21.15.143:0/3723574660 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 0x7f9ddc0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9ddbfff640 1 -- 172.21.15.143:0/3723574660 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 msgr2=0x7f9ddc0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:53.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9ddbfff640 1 --2- 172.21.15.143:0/3723574660 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 0x7f9ddc0723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9ddbfff640 1 -- 172.21.15.143:0/3723574660 >> v2:172.21.15.163:3300/0 conn(0x7f9ddc0b03b0 msgr2=0x7f9ddc0d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:53.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9ddbfff640 1 --2- 172.21.15.143:0/3723574660 >> v2:172.21.15.163:3300/0 conn(0x7f9ddc0b03b0 0x7f9ddc0d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9ddbfff640 1 -- 172.21.15.143:0/3723574660 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc0af0b0 con 0x7f9ddc072900 2024-05-08T10:24:53.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.737+0000 7f9de1477640 1 --2- 172.21.15.143:0/3723574660 >> v2:172.21.15.163:3300/0 conn(0x7f9ddc0b03b0 0x7f9ddc0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:53.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.738+0000 7f9ddbfff640 1 --2- 172.21.15.143:0/3723574660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc072900 0x7f9ddc0afe70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc145e30 tx=0x7f9dc802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c78cee90cf31b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.738+0000 7f9ddb7fe640 1 -- 172.21.15.143:0/3723574660 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8037070 con 0x7f9ddc072900 2024-05-08T10:24:53.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.738+0000 7f9ddb7fe640 1 -- 172.21.15.143:0/3723574660 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc8032440 con 0x7f9ddc072900 2024-05-08T10:24:53.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.738+0000 7f9ddb7fe640 1 -- 172.21.15.143:0/3723574660 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8032810 con 0x7f9ddc072900 2024-05-08T10:24:53.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.739+0000 7f9de2eda640 1 -- 172.21.15.143:0/3723574660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc072900 msgr2=0x7f9ddc0afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.727 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.739+0000 7f9de2eda640 1 --2- 172.21.15.143:0/3723574660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc072900 0x7f9ddc0afe70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc145e30 tx=0x7f9dc802a140 comp rx=0 tx=0).stop 2024-05-08T10:24:53.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.739+0000 7f9de2eda640 1 -- 172.21.15.143:0/3723574660 shutdown_connections 2024-05-08T10:24:53.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.739+0000 7f9de2eda640 1 --2- 172.21.15.143:0/3723574660 >> v2:172.21.15.163:3300/0 conn(0x7f9ddc0b03b0 0x7f9ddc0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.739+0000 7f9de2eda640 1 --2- 172.21.15.143:0/3723574660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc072900 0x7f9ddc0afe70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.739+0000 7f9de2eda640 1 --2- 172.21.15.143:0/3723574660 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 0x7f9ddc0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.739+0000 7f9de2eda640 1 -- 172.21.15.143:0/3723574660 >> 172.21.15.143:0/3723574660 conn(0x7f9ddc06c740 msgr2=0x7f9ddc06cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:53.728 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.739+0000 7f9de2eda640 1 -- 172.21.15.143:0/3723574660 shutdown_connections 2024-05-08T10:24:53.729 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.739+0000 7f9de2eda640 1 -- 172.21.15.143:0/3723574660 wait complete. 2024-05-08T10:24:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.740+0000 7f9de2eda640 1 Processor -- start 2024-05-08T10:24:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.740+0000 7f9de2eda640 1 -- start start 2024-05-08T10:24:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9de2eda640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ddc072900 0x7f9ddc143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9de2eda640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc0b03b0 0x7f9ddc15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9de2eda640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 0x7f9ddc09e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9de2eda640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc1450c0 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9de2eda640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0af670 con 0x7f9ddc072900 2024-05-08T10:24:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9de2eda640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc145240 con 0x7f9ddc144ce0 2024-05-08T10:24:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9ddbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc0b03b0 0x7f9ddc15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9ddbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc0b03b0 0x7f9ddc15b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39416/0 (socket says 172.21.15.143:39416) 2024-05-08T10:24:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9ddbfff640 1 -- 172.21.15.143:0/1426229821 learned_addr learned my addr 172.21.15.143:0/1426229821 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9de0c76640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ddc072900 0x7f9ddc143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9de1477640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 0x7f9ddc09e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9ddbfff640 1 -- 172.21.15.143:0/1426229821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 msgr2=0x7f9ddc09e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9ddbfff640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 0x7f9ddc09e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9ddbfff640 1 -- 172.21.15.143:0/1426229821 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ddc072900 msgr2=0x7f9ddc143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9ddbfff640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ddc072900 0x7f9ddc143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.734 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9ddbfff640 1 -- 172.21.15.143:0/1426229821 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc15bd90 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9de1477640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 0x7f9ddc09e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:53.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9ddbfff640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc0b03b0 0x7f9ddc15b850 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9dc802a180 tx=0x7f9dc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.741+0000 7f9dd97fa640 1 -- 172.21.15.143:0/1426229821 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8041020 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.742+0000 7f9dd97fa640 1 -- 172.21.15.143:0/1426229821 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc80306c0 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.735 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.742+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc09cbe0 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.742+0000 7f9dd97fa640 1 -- 172.21.15.143:0/1426229821 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8037040 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.742+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc09d1a0 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.743+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ddc06a4b0 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.743+0000 7f9dd97fa640 1 -- 172.21.15.143:0/1426229821 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9dc8044020 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.744+0000 7f9dd97fa640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9dc0076300 0x7f9dc00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:53.736 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.744+0000 7f9dd97fa640 1 -- 172.21.15.143:0/1426229821 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f9dc80b7ab0 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.744+0000 7f9de0c76640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9dc0076300 0x7f9dc00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:53.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.744+0000 7f9de0c76640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9dc0076300 0x7f9dc00787c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0006fd0 tx=0x7f9dd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:53.737 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.748+0000 7f9dd97fa640 1 -- 172.21.15.143:0/1426229821 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9dc804b030 con 0x7f9ddc0b03b0 2024-05-08T10:24:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.933+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9ddc0734d0 con 0x7f9dc0076300 2024-05-08T10:24:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.934+0000 7f9dd97fa640 1 -- 172.21.15.143:0/1426229821 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9ddc0734d0 con 0x7f9dc0076300 2024-05-08T10:24:53.919 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T10:24:53.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9dc0076300 msgr2=0x7f9dc00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.921 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9dc0076300 0x7f9dc00787c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0006fd0 tx=0x7f9dd0008040 comp rx=0 tx=0).stop 2024-05-08T10:24:53.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc0b03b0 msgr2=0x7f9ddc15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:53.922 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc0b03b0 0x7f9ddc15b850 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9dc802a180 tx=0x7f9dc80046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 shutdown_connections 2024-05-08T10:24:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9ddc144ce0 0x7f9ddc09e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9dc0076300 0x7f9dc00787c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ddc0b03b0 0x7f9ddc15b850 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 --2- 172.21.15.143:0/1426229821 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ddc072900 0x7f9ddc143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 >> 172.21.15.143:0/1426229821 conn(0x7f9ddc06c740 msgr2=0x7f9ddc0b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 shutdown_connections 2024-05-08T10:24:53.923 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:53.936+0000 7f9de2eda640 1 -- 172.21.15.143:0/1426229821 wait complete. 2024-05-08T10:24:53.932 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T10:24:53.932 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:24:54.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.052+0000 7f1f871f7640 1 Processor -- start 2024-05-08T10:24:54.037 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.052+0000 7f1f871f7640 1 -- start start 2024-05-08T10:24:54.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f871f7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1f8006cd30 0x7f1f800af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f871f7640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f80163020 con 0x7f1f80162c40 2024-05-08T10:24:54.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f871f7640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f8006d1c0 con 0x7f1f800b2c90 2024-05-08T10:24:54.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f871f7640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1f800b1cb0 con 0x7f1f8006cd30 2024-05-08T10:24:54.039 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f7ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1f8006cd30 0x7f1f800af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f84f93640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1f80162c40 0x7f1f800b2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54238/0 (socket says 172.21.15.143:54238) 2024-05-08T10:24:54.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f84f93640 1 -- 172.21.15.143:0/204319515 learned_addr learned my addr 172.21.15.143:0/204319515 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:54.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f7ffff640 1 -- 172.21.15.143:0/204319515 >> v1:172.21.15.163:6789/0 conn(0x7f1f800b2c90 legacy=0x7f1f800d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:54.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f7ffff640 1 -- 172.21.15.143:0/204319515 >> v1:172.21.15.143:6789/0 conn(0x7f1f80162c40 legacy=0x7f1f800b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.040 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f7ffff640 1 -- 172.21.15.143:0/204319515 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f800b1f90 con 0x7f1f8006cd30 2024-05-08T10:24:54.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.053+0000 7f1f7f7fe640 1 -- 172.21.15.143:0/204319515 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777770921 0 0) 0x7f1f80163020 con 0x7f1f80162c40 2024-05-08T10:24:54.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.054+0000 7f1f7ffff640 1 --2- 172.21.15.143:0/204319515 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f8006cd30 0x7f1f800af010 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097a0 tx=0x7f1f6c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cb6440e91a96ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.054+0000 7f1f7f7fe640 1 -- 172.21.15.143:0/204319515 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c037070 con 0x7f1f8006cd30 2024-05-08T10:24:54.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.054+0000 7f1f7f7fe640 1 -- 172.21.15.143:0/204319515 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c032440 con 0x7f1f8006cd30 2024-05-08T10:24:54.041 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.054+0000 7f1f7f7fe640 1 -- 172.21.15.143:0/204319515 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c032810 con 0x7f1f8006cd30 2024-05-08T10:24:54.045 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.054+0000 7f1f871f7640 1 -- 172.21.15.143:0/204319515 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f8006cd30 msgr2=0x7f1f800af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.045 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.054+0000 7f1f871f7640 1 --2- 172.21.15.143:0/204319515 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f8006cd30 0x7f1f800af010 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097a0 tx=0x7f1f6c02a210 comp rx=0 tx=0).stop 2024-05-08T10:24:54.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.054+0000 7f1f871f7640 1 -- 172.21.15.143:0/204319515 shutdown_connections 2024-05-08T10:24:54.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.054+0000 7f1f871f7640 1 --2- 172.21.15.143:0/204319515 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f8006cd30 0x7f1f800af010 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.055+0000 7f1f871f7640 1 -- 172.21.15.143:0/204319515 >> 172.21.15.143:0/204319515 conn(0x7f1f800739a0 msgr2=0x7f1f800b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.055+0000 7f1f871f7640 1 -- 172.21.15.143:0/204319515 shutdown_connections 2024-05-08T10:24:54.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.055+0000 7f1f871f7640 1 -- 172.21.15.143:0/204319515 wait complete. 2024-05-08T10:24:54.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.056+0000 7f1f871f7640 1 Processor -- start 2024-05-08T10:24:54.046 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.056+0000 7f1f871f7640 1 -- start start 2024-05-08T10:24:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f871f7640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f800b2c90 0x7f1f800b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f871f7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f80162c40 0x7f1f800b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f871f7640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f8009fcb0 0x7f1f8009cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f871f7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1f800b4a80 con 0x7f1f80162c40 2024-05-08T10:24:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f871f7640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1f800d0800 con 0x7f1f800b2c90 2024-05-08T10:24:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f871f7640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f1f800b4c00 con 0x7f1f8009fcb0 2024-05-08T10:24:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f80162c40 0x7f1f800b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f80162c40 0x7f1f800b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39440/0 (socket says 172.21.15.143:39440) 2024-05-08T10:24:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7ffff640 1 -- 172.21.15.143:0/347591769 learned_addr learned my addr 172.21.15.143:0/347591769 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f84f93640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f800b2c90 0x7f1f800b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7ffff640 1 -- 172.21.15.143:0/347591769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f8009fcb0 msgr2=0x7f1f8009cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f85794640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f8009fcb0 0x7f1f8009cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.048 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7ffff640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1f8009fcb0 0x7f1f8009cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7ffff640 1 -- 172.21.15.143:0/347591769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f800b2c90 msgr2=0x7f1f800b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7ffff640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f800b2c90 0x7f1f800b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7ffff640 1 -- 172.21.15.143:0/347591769 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f800a0120 con 0x7f1f80162c40 2024-05-08T10:24:54.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f84f93640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f800b2c90 0x7f1f800b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:54.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7ffff640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f80162c40 0x7f1f800b4e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097a0 tx=0x7f1f6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7d7fa640 1 -- 172.21.15.143:0/347591769 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c037040 con 0x7f1f80162c40 2024-05-08T10:24:54.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7d7fa640 1 -- 172.21.15.143:0/347591769 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c004250 con 0x7f1f80162c40 2024-05-08T10:24:54.049 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f7d7fa640 1 -- 172.21.15.143:0/347591769 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c032e20 con 0x7f1f80162c40 2024-05-08T10:24:54.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f800b5510 con 0x7f1f80162c40 2024-05-08T10:24:54.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.057+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f800b5ad0 con 0x7f1f80162c40 2024-05-08T10:24:54.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.058+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f800b6190 con 0x7f1f80162c40 2024-05-08T10:24:54.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.059+0000 7f1f7d7fa640 1 -- 172.21.15.143:0/347591769 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1f6c030770 con 0x7f1f80162c40 2024-05-08T10:24:54.050 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.059+0000 7f1f7d7fa640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1f640762d0 0x7f1f64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.059+0000 7f1f7d7fa640 1 -- 172.21.15.143:0/347591769 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f1f6c0b8540 con 0x7f1f80162c40 2024-05-08T10:24:54.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.059+0000 7f1f84f93640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1f640762d0 0x7f1f64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.060+0000 7f1f7d7fa640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f1f6407c190 0x7f1f6407e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.060+0000 7f1f7d7fa640 1 -- 172.21.15.143:0/347591769 --> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f6c001d30 con 0x7f1f6407c190 2024-05-08T10:24:54.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.060+0000 7f1f7d7fa640 1 -- 172.21.15.143:0/347591769 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1f6c0bf050 con 0x7f1f80162c40 2024-05-08T10:24:54.051 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.060+0000 7f1f85794640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f1f6407c190 0x7f1f6407e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.060+0000 7f1f84f93640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1f640762d0 0x7f1f64078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f74001220 tx=0x7f1f74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.060+0000 7f1f85794640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f1f6407c190 0x7f1f6407e5b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.052 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.061+0000 7f1f7d7fa640 1 -- 172.21.15.143:0/347591769 <== osd.2 v2:172.21.15.143:6808/2912298193 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f6c001d30 con 0x7f1f6407c190 2024-05-08T10:24:54.058 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 --> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1f8006a550 con 0x7f1f6407c190 2024-05-08T10:24:54.059 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f7d7fa640 1 -- 172.21.15.143:0/347591769 <== osd.2 v2:172.21.15.143:6808/2912298193 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1f8006a550 con 0x7f1f6407c190 2024-05-08T10:24:54.059 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:54.059 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:24:54.059 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:54.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f1f6407c190 msgr2=0x7f1f6407e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6808/2912298193,v1:172.21.15.143:6809/2912298193] conn(0x7f1f6407c190 0x7f1f6407e5b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1f640762d0 msgr2=0x7f1f64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1f640762d0 0x7f1f64078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f74001220 tx=0x7f1f74009040 comp rx=0 tx=0).stop 2024-05-08T10:24:54.061 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f80162c40 msgr2=0x7f1f800b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 --2- 172.21.15.143:0/347591769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f80162c40 0x7f1f800b4e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097a0 tx=0x7f1f6c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f85794640 1 -- 172.21.15.143:0/347591769 reap_dead start 2024-05-08T10:24:54.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 shutdown_connections 2024-05-08T10:24:54.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 >> 172.21.15.143:0/347591769 conn(0x7f1f800739a0 msgr2=0x7f1f801611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.063 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 shutdown_connections 2024-05-08T10:24:54.063 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.074+0000 7f1f871f7640 1 -- 172.21.15.143:0/347591769 wait complete. 2024-05-08T10:24:54.070 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T10:24:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.187+0000 7f4df3220640 1 Processor -- start 2024-05-08T10:24:54.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.187+0000 7f4df3220640 1 -- start start 2024-05-08T10:24:54.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4df3220640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec0d3930 0x7f4dec0d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4df3220640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dec0d1560 con 0x7f4dec0d5ee0 2024-05-08T10:24:54.176 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4df3220640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dec0d0cc0 con 0x7f4dec1630d0 2024-05-08T10:24:54.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4df3220640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec0d0fa0 con 0x7f4dec0d3930 2024-05-08T10:24:54.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4debfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4dec0d5ee0 0x7f4dec1629c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54250/0 (socket says 172.21.15.143:54250) 2024-05-08T10:24:54.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4debfff640 1 -- 172.21.15.143:0/553674818 learned_addr learned my addr 172.21.15.143:0/553674818 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:54.177 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4df0fbc640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec0d3930 0x7f4dec0d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311079802 0 0) 0x7f4dec0d1560 con 0x7f4dec0d5ee0 2024-05-08T10:24:54.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ddc003520 con 0x7f4dec0d5ee0 2024-05-08T10:24:54.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1584277553 0 0) 0x7f4ddc003520 con 0x7f4dec0d5ee0 2024-05-08T10:24:54.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec0d3930 msgr2=0x7f4dec0d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:54.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec0d3930 0x7f4dec0d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 >> v1:172.21.15.163:6789/0 conn(0x7f4dec1630d0 legacy=0x7f4dec06d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec0d1280 con 0x7f4dec0d5ee0 2024-05-08T10:24:54.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f4dd80016f0 con 0x7f4dec0d5ee0 2024-05-08T10:24:54.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 >> v1:172.21.15.143:6789/0 conn(0x7f4dec0d5ee0 legacy=0x7f4dec1629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc0039e0 0x7f4ddc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ddc004800 0x7f4ddc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec0d3930 0x7f4ddc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0d0fa0 con 0x7f4ddc0039e0 2024-05-08T10:24:54.179 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc00ba70 con 0x7f4ddc004800 2024-05-08T10:24:54.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4ddc00bc70 con 0x7f4dec0d3930 2024-05-08T10:24:54.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.188+0000 7f4df0fbc640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc0039e0 0x7f4ddc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.189+0000 7f4debfff640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ddc004800 0x7f4ddc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.189+0000 7f4df17bd640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec0d3930 0x7f4ddc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.189+0000 7f4df0fbc640 1 -- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec0d3930 msgr2=0x7f4ddc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:54.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.189+0000 7f4df0fbc640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec0d3930 0x7f4ddc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.189+0000 7f4df0fbc640 1 -- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ddc004800 msgr2=0x7f4ddc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:54.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.189+0000 7f4df0fbc640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ddc004800 0x7f4ddc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.189+0000 7f4df0fbc640 1 -- 172.21.15.143:0/553674818 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc003520 con 0x7f4ddc0039e0 2024-05-08T10:24:54.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.189+0000 7f4df0fbc640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc0039e0 0x7f4ddc003dc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009a90 tx=0x7f4ddc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f2559c45df3ea2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.189+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0036070 con 0x7f4ddc0039e0 2024-05-08T10:24:54.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.190+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de0031400 con 0x7f4ddc0039e0 2024-05-08T10:24:54.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.190+0000 7f4deb7fe640 1 -- 172.21.15.143:0/553674818 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0009690 con 0x7f4ddc0039e0 2024-05-08T10:24:54.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.190+0000 7f4df3220640 1 -- 172.21.15.143:0/553674818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc0039e0 msgr2=0x7f4ddc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.190+0000 7f4df3220640 1 --2- 172.21.15.143:0/553674818 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ddc0039e0 0x7f4ddc003dc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009a90 tx=0x7f4ddc005830 comp rx=0 tx=0).stop 2024-05-08T10:24:54.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.190+0000 7f4df17bd640 1 -- 172.21.15.143:0/553674818 reap_dead start 2024-05-08T10:24:54.182 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.190+0000 7f4df3220640 1 -- 172.21.15.143:0/553674818 shutdown_connections 2024-05-08T10:24:54.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.190+0000 7f4df3220640 1 -- 172.21.15.143:0/553674818 >> 172.21.15.143:0/553674818 conn(0x7f4dec08cfa0 msgr2=0x7f4dec0d5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.190+0000 7f4df3220640 1 -- 172.21.15.143:0/553674818 shutdown_connections 2024-05-08T10:24:54.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.190+0000 7f4df3220640 1 -- 172.21.15.143:0/553674818 wait complete. 2024-05-08T10:24:54.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.191+0000 7f4df3220640 1 Processor -- start 2024-05-08T10:24:54.183 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.191+0000 7f4df3220640 1 -- start start 2024-05-08T10:24:54.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4df3220640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ddc0039e0 0x7f4dec0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4df3220640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dec0ce3c0 0x7f4dec0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.186 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4df3220640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec1f4dc0 0x7f4dec0ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4df3220640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0d3e90 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4df3220640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0d3d10 con 0x7f4ddc0039e0 2024-05-08T10:24:54.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4df3220640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec0d4010 con 0x7f4dec1f4dc0 2024-05-08T10:24:54.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4debfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dec0ce3c0 0x7f4dec0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.187 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4debfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dec0ce3c0 0x7f4dec0b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39464/0 (socket says 172.21.15.143:39464) 2024-05-08T10:24:54.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4debfff640 1 -- 172.21.15.143:0/1530156080 learned_addr learned my addr 172.21.15.143:0/1530156080 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:54.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4df0fbc640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ddc0039e0 0x7f4dec0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.192+0000 7f4df17bd640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec1f4dc0 0x7f4dec0ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4debfff640 1 -- 172.21.15.143:0/1530156080 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec1f4dc0 msgr2=0x7f4dec0ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4debfff640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec1f4dc0 0x7f4dec0ba3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4debfff640 1 -- 172.21.15.143:0/1530156080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ddc0039e0 msgr2=0x7f4dec0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4debfff640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ddc0039e0 0x7f4dec0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.188 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4debfff640 1 -- 172.21.15.143:0/1530156080 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec0b7f20 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4debfff640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dec0ce3c0 0x7f4dec0b9e60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8001b90 tx=0x7f4dd8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4de97fa640 1 -- 172.21.15.143:0/1530156080 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800f9c0 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4de97fa640 1 -- 172.21.15.143:0/1530156080 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd8018070 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec0b8200 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4de97fa640 1 -- 172.21.15.143:0/1530156080 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800fda0 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.193+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec0b87c0 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.189 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.194+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec06a4b0 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.194+0000 7f4de97fa640 1 -- 172.21.15.143:0/1530156080 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4dd801d460 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.195+0000 7f4de97fa640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4dd00762d0 0x7f4dd0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.195+0000 7f4df0fbc640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4dd00762d0 0x7f4dd0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.195+0000 7f4de97fa640 1 -- 172.21.15.143:0/1530156080 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f4dd8097170 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.190 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.196+0000 7f4df0fbc640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4dd00762d0 0x7f4dd0078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009a90 tx=0x7f4de0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.191 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.200+0000 7f4de97fa640 1 -- 172.21.15.143:0/1530156080 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4dd8060810 con 0x7f4dec0ce3c0 2024-05-08T10:24:54.365 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.380+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4dec0cf170 con 0x7f4dd00762d0 2024-05-08T10:24:54.366 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.380+0000 7f4de97fa640 1 -- 172.21.15.143:0/1530156080 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4dec0cf170 con 0x7f4dd00762d0 2024-05-08T10:24:54.366 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T10:24:54.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4dd00762d0 msgr2=0x7f4dd0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4dd00762d0 0x7f4dd0078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009a90 tx=0x7f4de0008030 comp rx=0 tx=0).stop 2024-05-08T10:24:54.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dec0ce3c0 msgr2=0x7f4dec0b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dec0ce3c0 0x7f4dec0b9e60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8001b90 tx=0x7f4dd8007720 comp rx=0 tx=0).stop 2024-05-08T10:24:54.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 shutdown_connections 2024-05-08T10:24:54.368 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4dec1f4dc0 0x7f4dec0ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4dd00762d0 0x7f4dd0078790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dec0ce3c0 0x7f4dec0b9e60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 --2- 172.21.15.143:0/1530156080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ddc0039e0 0x7f4dec0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 >> 172.21.15.143:0/1530156080 conn(0x7f4dec08cfa0 msgr2=0x7f4dec157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 shutdown_connections 2024-05-08T10:24:54.369 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.382+0000 7f4df3220640 1 -- 172.21.15.143:0/1530156080 wait complete. 2024-05-08T10:24:54.379 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T10:24:54.379 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:24:54.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.498+0000 7fa7fa675640 1 Processor -- start 2024-05-08T10:24:54.483 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.498+0000 7fa7fa675640 1 -- start start 2024-05-08T10:24:54.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7fa675640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa7f40b6290 0x7fa7f415d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7fa675640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f415c860 con 0x7fa7f40b5e00 2024-05-08T10:24:54.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7fa675640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f406fcf0 con 0x7fa7f4145c50 2024-05-08T10:24:54.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7fa675640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f406ffd0 con 0x7fa7f40b6290 2024-05-08T10:24:54.485 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7f37fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa7f40b5e00 0x7fa7f415ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54260/0 (socket says 172.21.15.143:54260) 2024-05-08T10:24:54.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7f37fe640 1 -- 172.21.15.143:0/2596578535 learned_addr learned my addr 172.21.15.143:0/2596578535 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:54.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7f8c12640 1 --2- 172.21.15.143:0/2596578535 >> v2:172.21.15.143:3300/0 conn(0x7fa7f40b6290 0x7fa7f415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7f8c12640 1 -- 172.21.15.143:0/2596578535 >> v1:172.21.15.163:6789/0 conn(0x7fa7f4145c50 legacy=0x7fa7f406f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7f8c12640 1 -- 172.21.15.143:0/2596578535 >> v1:172.21.15.143:6789/0 conn(0x7fa7f40b5e00 legacy=0x7fa7f415ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7f8c12640 1 -- 172.21.15.143:0/2596578535 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f40702b0 con 0x7fa7f40b6290 2024-05-08T10:24:54.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.499+0000 7fa7f2ffd640 1 -- 172.21.15.143:0/2596578535 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461086395 0 0) 0x7fa7f415c860 con 0x7fa7f40b5e00 2024-05-08T10:24:54.486 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.500+0000 7fa7f8c12640 1 --2- 172.21.15.143:0/2596578535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b6290 0x7fa7f415d400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009d90 tx=0x7fa7ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7618388e881e9e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.500+0000 7fa7f2ffd640 1 -- 172.21.15.143:0/2596578535 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec007740 con 0x7fa7f40b6290 2024-05-08T10:24:54.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.500+0000 7fa7f2ffd640 1 -- 172.21.15.143:0/2596578535 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0078e0 con 0x7fa7f40b6290 2024-05-08T10:24:54.487 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.500+0000 7fa7f2ffd640 1 -- 172.21.15.143:0/2596578535 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec007cb0 con 0x7fa7f40b6290 2024-05-08T10:24:54.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.501+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596578535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b6290 msgr2=0x7fa7f415d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.501+0000 7fa7fa675640 1 --2- 172.21.15.143:0/2596578535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b6290 0x7fa7f415d400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009d90 tx=0x7fa7ec02a660 comp rx=0 tx=0).stop 2024-05-08T10:24:54.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.501+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596578535 shutdown_connections 2024-05-08T10:24:54.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.501+0000 7fa7fa675640 1 --2- 172.21.15.143:0/2596578535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b6290 0x7fa7f415d400 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.490 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.501+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596578535 >> 172.21.15.143:0/2596578535 conn(0x7fa7f406c320 msgr2=0x7fa7f406c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.501+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596578535 shutdown_connections 2024-05-08T10:24:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.501+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596578535 wait complete. 2024-05-08T10:24:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.502+0000 7fa7fa675640 1 Processor -- start 2024-05-08T10:24:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.502+0000 7fa7fa675640 1 -- start start 2024-05-08T10:24:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7fa675640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b5e00 0x7fa7f415bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7fa675640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7f40b6290 0x7fa7f4141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7fa675640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7f4145c50 0x7fa7f41420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.491 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7fa675640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f4146030 con 0x7fa7f40b5e00 2024-05-08T10:24:54.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7fa675640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f406d0b0 con 0x7fa7f40b6290 2024-05-08T10:24:54.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7fa675640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f4070590 con 0x7fa7f4145c50 2024-05-08T10:24:54.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b5e00 0x7fa7f415bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b5e00 0x7fa7f415bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39476/0 (socket says 172.21.15.143:39476) 2024-05-08T10:24:54.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f3fff640 1 -- 172.21.15.143:0/2596957414 learned_addr learned my addr 172.21.15.143:0/2596957414 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:54.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f37fe640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7f40b6290 0x7fa7f4141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.492 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f3fff640 1 -- 172.21.15.143:0/2596957414 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7f4145c50 msgr2=0x7fa7f41420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f8c12640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7f4145c50 0x7fa7f41420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f3fff640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa7f4145c50 0x7fa7f41420c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f3fff640 1 -- 172.21.15.143:0/2596957414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7f40b6290 msgr2=0x7fa7f4141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f3fff640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7f40b6290 0x7fa7f4141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f3fff640 1 -- 172.21.15.143:0/2596957414 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f415c1c0 con 0x7fa7f40b5e00 2024-05-08T10:24:54.493 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f37fe640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7f40b6290 0x7fa7f4141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:54.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f3fff640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b5e00 0x7fa7f415bc80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400c400 tx=0x7fa7e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.503+0000 7fa7f0ff9640 1 -- 172.21.15.143:0/2596957414 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4017070 con 0x7fa7f40b5e00 2024-05-08T10:24:54.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.504+0000 7fa7f0ff9640 1 -- 172.21.15.143:0/2596957414 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e40052d0 con 0x7fa7f40b5e00 2024-05-08T10:24:54.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.504+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f41e8170 con 0x7fa7f40b5e00 2024-05-08T10:24:54.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.504+0000 7fa7f0ff9640 1 -- 172.21.15.143:0/2596957414 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4003830 con 0x7fa7f40b5e00 2024-05-08T10:24:54.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.504+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f41e8730 con 0x7fa7f40b5e00 2024-05-08T10:24:54.494 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.504+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7f412f5a0 con 0x7fa7f40b5e00 2024-05-08T10:24:54.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.505+0000 7fa7f0ff9640 1 -- 172.21.15.143:0/2596957414 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa7e401a070 con 0x7fa7f40b5e00 2024-05-08T10:24:54.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.506+0000 7fa7f0ff9640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa7e00762d0 0x7fa7e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.506+0000 7fa7f0ff9640 1 -- 172.21.15.143:0/2596957414 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fa7e4096e40 con 0x7fa7f40b5e00 2024-05-08T10:24:54.497 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.506+0000 7fa7f37fe640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa7e00762d0 0x7fa7e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.506+0000 7fa7f0ff9640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7fa7e007c190 0x7fa7e007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.506+0000 7fa7f0ff9640 1 -- 172.21.15.143:0/2596957414 --> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7e401dec0 con 0x7fa7e007c190 2024-05-08T10:24:54.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.506+0000 7fa7f0ff9640 1 -- 172.21.15.143:0/2596957414 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa7e40972d0 con 0x7fa7f40b5e00 2024-05-08T10:24:54.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.506+0000 7fa7f8c12640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7fa7e007c190 0x7fa7e007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.506+0000 7fa7f37fe640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa7e00762d0 0x7fa7e0078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8007fd0 tx=0x7fa7e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.506+0000 7fa7f8c12640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7fa7e007c190 0x7fa7e007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.498 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.507+0000 7fa7f0ff9640 1 -- 172.21.15.143:0/2596957414 <== osd.3 v2:172.21.15.143:6824/2042563744 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7e401dec0 con 0x7fa7e007c190 2024-05-08T10:24:54.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.520+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 --> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa7f415f0e0 con 0x7fa7e007c190 2024-05-08T10:24:54.505 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.520+0000 7fa7f0ff9640 1 -- 172.21.15.143:0/2596957414 <== osd.3 v2:172.21.15.143:6824/2042563744 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa7f415f0e0 con 0x7fa7e007c190 2024-05-08T10:24:54.505 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:54.506 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:24:54.506 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:54.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.520+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7fa7e007c190 msgr2=0x7fa7e007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.520+0000 7fa7fa675640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6824/2042563744,v1:172.21.15.143:6825/2042563744] conn(0x7fa7e007c190 0x7fa7e007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.521+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa7e00762d0 msgr2=0x7fa7e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.521+0000 7fa7fa675640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa7e00762d0 0x7fa7e0078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8007fd0 tx=0x7fa7e8009040 comp rx=0 tx=0).stop 2024-05-08T10:24:54.507 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.521+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b5e00 msgr2=0x7fa7f415bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.521+0000 7fa7fa675640 1 --2- 172.21.15.143:0/2596957414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7f40b5e00 0x7fa7f415bc80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400c400 tx=0x7fa7e400c8c0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.521+0000 7fa7f8c12640 1 -- 172.21.15.143:0/2596957414 reap_dead start 2024-05-08T10:24:54.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.521+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 shutdown_connections 2024-05-08T10:24:54.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.521+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 >> 172.21.15.143:0/2596957414 conn(0x7fa7f406c320 msgr2=0x7fa7f40b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.521+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 shutdown_connections 2024-05-08T10:24:54.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.521+0000 7fa7fa675640 1 -- 172.21.15.143:0/2596957414 wait complete. 2024-05-08T10:24:54.516 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T10:24:54.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.632+0000 7fa843724640 1 Processor -- start 2024-05-08T10:24:54.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.632+0000 7fa843724640 1 -- start start 2024-05-08T10:24:54.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa843724640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa83c148cf0 0x7fa83c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa843724640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c0b57f0 0x7fa83c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa843724640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83c0b6000 con 0x7fa83c0b07c0 2024-05-08T10:24:54.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa843724640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa83c0b62e0 con 0x7fa83c148cf0 2024-05-08T10:24:54.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa843724640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa83c0afa80 con 0x7fa83c0b57f0 2024-05-08T10:24:54.621 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa841cc1640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa83c0b07c0 0x7fa83c06e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54262/0 (socket says 172.21.15.143:54262) 2024-05-08T10:24:54.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa841cc1640 1 -- 172.21.15.143:0/1521636236 learned_addr learned my addr 172.21.15.143:0/1521636236 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:54.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa8414c0640 1 --2- 172.21.15.143:0/1521636236 >> v2:172.21.15.163:3300/0 conn(0x7fa83c148cf0 0x7fa83c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa840cbf640 1 --2- 172.21.15.143:0/1521636236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c0b57f0 0x7fa83c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa833fff640 1 -- 172.21.15.143:0/1521636236 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027260705 0 0) 0x7fa83c0b6000 con 0x7fa83c0b07c0 2024-05-08T10:24:54.622 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.633+0000 7fa833fff640 1 -- 172.21.15.143:0/1521636236 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa828003520 con 0x7fa83c0b07c0 2024-05-08T10:24:54.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.634+0000 7fa833fff640 1 -- 172.21.15.143:0/1521636236 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 95169077 0 0) 0x7fa828003520 con 0x7fa83c0b07c0 2024-05-08T10:24:54.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.634+0000 7fa8414c0640 1 -- 172.21.15.143:0/1521636236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c0b57f0 msgr2=0x7fa83c0b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:54.623 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.634+0000 7fa8414c0640 1 --2- 172.21.15.143:0/1521636236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c0b57f0 0x7fa83c0b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.634+0000 7fa8414c0640 1 -- 172.21.15.143:0/1521636236 >> v1:172.21.15.143:6789/0 conn(0x7fa83c0b07c0 legacy=0x7fa83c06e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.634+0000 7fa8414c0640 1 -- 172.21.15.143:0/1521636236 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c0afd60 con 0x7fa83c148cf0 2024-05-08T10:24:54.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.634+0000 7fa8414c0640 1 --2- 172.21.15.143:0/1521636236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa83c148cf0 0x7fa83c0b5220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa838009d90 tx=0x7fa83802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fea21aa80e83c589 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa833fff640 1 -- 172.21.15.143:0/1521636236 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8340016f0 con 0x7fa83c148cf0 2024-05-08T10:24:54.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa833fff640 1 -- 172.21.15.143:0/1521636236 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa838007540 con 0x7fa83c148cf0 2024-05-08T10:24:54.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa833fff640 1 -- 172.21.15.143:0/1521636236 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8380078f0 con 0x7fa83c148cf0 2024-05-08T10:24:54.624 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa843724640 1 -- 172.21.15.143:0/1521636236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa83c148cf0 msgr2=0x7fa83c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa843724640 1 --2- 172.21.15.143:0/1521636236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa83c148cf0 0x7fa83c0b5220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa838009d90 tx=0x7fa83802a5f0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa843724640 1 -- 172.21.15.143:0/1521636236 shutdown_connections 2024-05-08T10:24:54.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa843724640 1 --2- 172.21.15.143:0/1521636236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c0b57f0 0x7fa83c0b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa843724640 1 --2- 172.21.15.143:0/1521636236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa83c148cf0 0x7fa83c0b5220 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa843724640 1 -- 172.21.15.143:0/1521636236 >> 172.21.15.143:0/1521636236 conn(0x7fa83c068530 msgr2=0x7fa83c06c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa843724640 1 -- 172.21.15.143:0/1521636236 shutdown_connections 2024-05-08T10:24:54.625 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.635+0000 7fa843724640 1 -- 172.21.15.143:0/1521636236 wait complete. 2024-05-08T10:24:54.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.636+0000 7fa843724640 1 Processor -- start 2024-05-08T10:24:54.628 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.636+0000 7fa843724640 1 -- start start 2024-05-08T10:24:54.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa843724640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b07c0 0x7fa83c15e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa843724640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa83c0b57f0 0x7fa83c162230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa843724640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c148cf0 0x7fa83c143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa843724640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c0af860 con 0x7fa83c0b07c0 2024-05-08T10:24:54.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa843724640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c0af6e0 con 0x7fa83c0b57f0 2024-05-08T10:24:54.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa843724640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa83c0b5c50 con 0x7fa83c148cf0 2024-05-08T10:24:54.629 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa8414c0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b07c0 0x7fa83c15e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa8414c0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b07c0 0x7fa83c15e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39486/0 (socket says 172.21.15.143:39486) 2024-05-08T10:24:54.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa8414c0640 1 -- 172.21.15.143:0/2313227220 learned_addr learned my addr 172.21.15.143:0/2313227220 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:54.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa841cc1640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c148cf0 0x7fa83c143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa8414c0640 1 -- 172.21.15.143:0/2313227220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c148cf0 msgr2=0x7fa83c143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa840cbf640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa83c0b57f0 0x7fa83c162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa8414c0640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c148cf0 0x7fa83c143bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.630 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa8414c0640 1 -- 172.21.15.143:0/2313227220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa83c0b57f0 msgr2=0x7fa83c162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.637+0000 7fa8414c0640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa83c0b57f0 0x7fa83c162230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.638+0000 7fa8414c0640 1 -- 172.21.15.143:0/2313227220 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c15ee10 con 0x7fa83c0b07c0 2024-05-08T10:24:54.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.638+0000 7fa8414c0640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b07c0 0x7fa83c15e8d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa838009eb0 tx=0x7fa838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.638+0000 7fa831ffb640 1 -- 172.21.15.143:0/2313227220 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838009450 con 0x7fa83c0b07c0 2024-05-08T10:24:54.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.638+0000 7fa831ffb640 1 -- 172.21.15.143:0/2313227220 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa838004240 con 0x7fa83c0b07c0 2024-05-08T10:24:54.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.638+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c1609a0 con 0x7fa83c0b07c0 2024-05-08T10:24:54.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.638+0000 7fa831ffb640 1 -- 172.21.15.143:0/2313227220 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8380045f0 con 0x7fa83c0b07c0 2024-05-08T10:24:54.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.638+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83c160f60 con 0x7fa83c0b07c0 2024-05-08T10:24:54.631 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.639+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83c06a4b0 con 0x7fa83c0b07c0 2024-05-08T10:24:54.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.640+0000 7fa831ffb640 1 -- 172.21.15.143:0/2313227220 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa838039040 con 0x7fa83c0b07c0 2024-05-08T10:24:54.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.640+0000 7fa831ffb640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa820076300 0x7fa8200787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.640+0000 7fa831ffb640 1 -- 172.21.15.143:0/2313227220 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fa8380b88a0 con 0x7fa83c0b07c0 2024-05-08T10:24:54.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.640+0000 7fa840cbf640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa820076300 0x7fa8200787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.641+0000 7fa840cbf640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa820076300 0x7fa8200787c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa83c15f510 tx=0x7fa82c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.632 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.644+0000 7fa831ffb640 1 -- 172.21.15.143:0/2313227220 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa838040030 con 0x7fa83c0b07c0 2024-05-08T10:24:54.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.824+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa83c1615b0 con 0x7fa820076300 2024-05-08T10:24:54.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.825+0000 7fa831ffb640 1 -- 172.21.15.143:0/2313227220 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa83c1615b0 con 0x7fa820076300 2024-05-08T10:24:54.810 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T10:24:54.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa820076300 msgr2=0x7fa8200787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa820076300 0x7fa8200787c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa83c15f510 tx=0x7fa82c008040 comp rx=0 tx=0).stop 2024-05-08T10:24:54.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b07c0 msgr2=0x7fa83c15e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b07c0 0x7fa83c15e8d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa838009eb0 tx=0x7fa838004a40 comp rx=0 tx=0).stop 2024-05-08T10:24:54.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 shutdown_connections 2024-05-08T10:24:54.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa83c148cf0 0x7fa83c143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa83c0b57f0 0x7fa83c162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa820076300 0x7fa8200787c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 --2- 172.21.15.143:0/2313227220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa83c0b07c0 0x7fa83c15e8d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 >> 172.21.15.143:0/2313227220 conn(0x7fa83c068530 msgr2=0x7fa83c0727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 shutdown_connections 2024-05-08T10:24:54.814 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.827+0000 7fa843724640 1 -- 172.21.15.143:0/2313227220 wait complete. 2024-05-08T10:24:54.823 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T10:24:54.823 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:24:54.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.942+0000 7fc9bf29c640 1 Processor -- start 2024-05-08T10:24:54.927 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.942+0000 7fc9bf29c640 1 -- start start 2024-05-08T10:24:54.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bf29c640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc9b80d3b60 0x7fc9b80b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.928 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bf29c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc9b80cf5a0 0x7fc9b80b7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bf29c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b80aff30 con 0x7fc9b8070e50 2024-05-08T10:24:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bf29c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b80b82b0 con 0x7fc9b80cf5a0 2024-05-08T10:24:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bf29c640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b8070900 con 0x7fc9b80d3b60 2024-05-08T10:24:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bd038640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fc9b8070e50 0x7fc9b8071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54274/0 (socket says 172.21.15.143:54274) 2024-05-08T10:24:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bd038640 1 -- 172.21.15.143:0/172479686 learned_addr learned my addr 172.21.15.143:0/172479686 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bd839640 1 --2- 172.21.15.143:0/172479686 >> v2:172.21.15.143:3300/0 conn(0x7fc9b80cf5a0 0x7fc9b80b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bd839640 1 -- 172.21.15.143:0/172479686 >> v2:172.21.15.163:3300/0 conn(0x7fc9b80d3b60 msgr2=0x7fc9b80b6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:54.929 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bd839640 1 --2- 172.21.15.143:0/172479686 >> v2:172.21.15.163:3300/0 conn(0x7fc9b80d3b60 0x7fc9b80b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bd839640 1 -- 172.21.15.143:0/172479686 >> v1:172.21.15.143:6789/0 conn(0x7fc9b8070e50 legacy=0x7fc9b8071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.930 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.943+0000 7fc9bd839640 1 -- 172.21.15.143:0/172479686 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b8071a20 con 0x7fc9b80cf5a0 2024-05-08T10:24:54.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.944+0000 7fc9bd839640 1 --2- 172.21.15.143:0/172479686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b80cf5a0 0x7fc9b80b7050 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80690f0 tx=0x7fc9b002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5380b66300bd845 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.944+0000 7fc9affff640 1 -- 172.21.15.143:0/172479686 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0007740 con 0x7fc9b80cf5a0 2024-05-08T10:24:54.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.944+0000 7fc9affff640 1 -- 172.21.15.143:0/172479686 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b00078e0 con 0x7fc9b80cf5a0 2024-05-08T10:24:54.933 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.944+0000 7fc9affff640 1 -- 172.21.15.143:0/172479686 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0007cb0 con 0x7fc9b80cf5a0 2024-05-08T10:24:54.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.945+0000 7fc9bf29c640 1 -- 172.21.15.143:0/172479686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b80cf5a0 msgr2=0x7fc9b80b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.945+0000 7fc9bf29c640 1 --2- 172.21.15.143:0/172479686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b80cf5a0 0x7fc9b80b7050 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80690f0 tx=0x7fc9b002a680 comp rx=0 tx=0).stop 2024-05-08T10:24:54.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.945+0000 7fc9bf29c640 1 -- 172.21.15.143:0/172479686 shutdown_connections 2024-05-08T10:24:54.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.945+0000 7fc9bf29c640 1 --2- 172.21.15.143:0/172479686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b80cf5a0 0x7fc9b80b7050 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.945+0000 7fc9bf29c640 1 --2- 172.21.15.143:0/172479686 >> v2:172.21.15.163:3300/0 conn(0x7fc9b80d3b60 0x7fc9b80b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.945+0000 7fc9bf29c640 1 -- 172.21.15.143:0/172479686 >> 172.21.15.143:0/172479686 conn(0x7fc9b80d3040 msgr2=0x7fc9b80d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.934 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.945+0000 7fc9bf29c640 1 -- 172.21.15.143:0/172479686 shutdown_connections 2024-05-08T10:24:54.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.945+0000 7fc9bf29c640 1 -- 172.21.15.143:0/172479686 wait complete. 2024-05-08T10:24:54.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.946+0000 7fc9bf29c640 1 Processor -- start 2024-05-08T10:24:54.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.946+0000 7fc9bf29c640 1 -- start start 2024-05-08T10:24:54.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bf29c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b8070e50 0x7fc9b815b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bf29c640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9b80cf5a0 0x7fc9b80ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bf29c640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b80d3b60 0x7fc9b80cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bf29c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b809cb40 con 0x7fc9b8070e50 2024-05-08T10:24:54.935 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bf29c640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b80b7e20 con 0x7fc9b80cf5a0 2024-05-08T10:24:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bf29c640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b8070b50 con 0x7fc9b80d3b60 2024-05-08T10:24:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bd038640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b8070e50 0x7fc9b815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bd038640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b8070e50 0x7fc9b815b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39514/0 (socket says 172.21.15.143:39514) 2024-05-08T10:24:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bd038640 1 -- 172.21.15.143:0/287019032 learned_addr learned my addr 172.21.15.143:0/287019032 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bd038640 1 -- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b80d3b60 msgr2=0x7fc9b80cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bd038640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b80d3b60 0x7fc9b80cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bd038640 1 -- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9b80cf5a0 msgr2=0x7fc9b80ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bc837640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9b80cf5a0 0x7fc9b80ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bd038640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9b80cf5a0 0x7fc9b80ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bd038640 1 -- 172.21.15.143:0/287019032 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b815bc60 con 0x7fc9b8070e50 2024-05-08T10:24:54.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bd038640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b8070e50 0x7fc9b815b720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001eb0 tx=0x7fc9b400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9adffb640 1 -- 172.21.15.143:0/287019032 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4017070 con 0x7fc9b8070e50 2024-05-08T10:24:54.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9adffb640 1 -- 172.21.15.143:0/287019032 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b4005d00 con 0x7fc9b8070e50 2024-05-08T10:24:54.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9adffb640 1 -- 172.21.15.143:0/287019032 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4007310 con 0x7fc9b8070e50 2024-05-08T10:24:54.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.947+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b815bf30 con 0x7fc9b8070e50 2024-05-08T10:24:54.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.948+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b815c4f0 con 0x7fc9b8070e50 2024-05-08T10:24:54.937 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.948+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9b806a550 con 0x7fc9b8070e50 2024-05-08T10:24:54.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.949+0000 7fc9adffb640 1 -- 172.21.15.143:0/287019032 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc9b401a070 con 0x7fc9b8070e50 2024-05-08T10:24:54.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.949+0000 7fc9adffb640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc99c0762d0 0x7fc99c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.949+0000 7fc9bc837640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc99c0762d0 0x7fc99c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.950+0000 7fc9adffb640 1 -- 172.21.15.143:0/287019032 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fc9b4096690 con 0x7fc9b8070e50 2024-05-08T10:24:54.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.950+0000 7fc9adffb640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc99c07c190 0x7fc99c07e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:54.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.950+0000 7fc9adffb640 1 -- 172.21.15.143:0/287019032 --> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc99c07ec60 con 0x7fc99c07c190 2024-05-08T10:24:54.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.950+0000 7fc9adffb640 1 -- 172.21.15.143:0/287019032 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc9b409d050 con 0x7fc9b8070e50 2024-05-08T10:24:54.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.950+0000 7fc9bd839640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc99c07c190 0x7fc99c07e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:54.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.950+0000 7fc9bc837640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc99c0762d0 0x7fc99c078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9b815cc10 tx=0x7fc9a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.950+0000 7fc9bd839640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc99c07c190 0x7fc99c07e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:54.940 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.951+0000 7fc9adffb640 1 -- 172.21.15.143:0/287019032 <== osd.4 v2:172.21.15.163:6808/4191344201 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc99c07ec60 con 0x7fc99c07c190 2024-05-08T10:24:54.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.964+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 --> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc9b80b05f0 con 0x7fc99c07c190 2024-05-08T10:24:54.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9adffb640 1 -- 172.21.15.143:0/287019032 <== osd.4 v2:172.21.15.163:6808/4191344201 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc9b80b05f0 con 0x7fc99c07c190 2024-05-08T10:24:54.950 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:54.950 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:24:54.950 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:54.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc99c07c190 msgr2=0x7fc99c07e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.163:6808/4191344201,v1:172.21.15.163:6809/4191344201] conn(0x7fc99c07c190 0x7fc99c07e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:54.951 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc99c0762d0 msgr2=0x7fc99c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fc99c0762d0 0x7fc99c078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9b815cc10 tx=0x7fc9a8008040 comp rx=0 tx=0).stop 2024-05-08T10:24:54.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b8070e50 msgr2=0x7fc9b815b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:54.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 --2- 172.21.15.143:0/287019032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9b8070e50 0x7fc9b815b720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001eb0 tx=0x7fc9b400c890 comp rx=0 tx=0).stop 2024-05-08T10:24:54.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bd839640 1 -- 172.21.15.143:0/287019032 reap_dead start 2024-05-08T10:24:54.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 shutdown_connections 2024-05-08T10:24:54.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 >> 172.21.15.143:0/287019032 conn(0x7fc9b80d3040 msgr2=0x7fc9b80b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:54.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 shutdown_connections 2024-05-08T10:24:54.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:54.965+0000 7fc9bf29c640 1 -- 172.21.15.143:0/287019032 wait complete. 2024-05-08T10:24:54.961 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T10:24:55.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.076+0000 7fa5298b0640 1 Processor -- start 2024-05-08T10:24:55.062 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.076+0000 7fa5298b0640 1 -- start start 2024-05-08T10:24:55.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.077+0000 7fa5298b0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa524146b60 0x7fa5240b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.077+0000 7fa5298b0640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa524071db0 0x7fa524072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.077+0000 7fa5298b0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa524072b80 con 0x7fa5240d22e0 2024-05-08T10:24:55.074 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.077+0000 7fa5298b0640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fa524072750 con 0x7fa524071db0 2024-05-08T10:24:55.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.077+0000 7fa5298b0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa5240b73a0 con 0x7fa524146b60 2024-05-08T10:24:55.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.077+0000 7fa5237fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa5240d22e0 0x7fa5240d2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54286/0 (socket says 172.21.15.143:54286) 2024-05-08T10:24:55.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.077+0000 7fa5237fe640 1 -- 172.21.15.143:0/1839231120 learned_addr learned my addr 172.21.15.143:0/1839231120 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:55.075 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa5227fc640 1 --2- 172.21.15.143:0/1839231120 >> v2:172.21.15.163:3300/0 conn(0x7fa524071db0 0x7fa524072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa522ffd640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa524146b60 0x7fa5240b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551457431 0 0) 0x7fa524072b80 con 0x7fa5240d22e0 2024-05-08T10:24:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa50c003520 con 0x7fa5240d22e0 2024-05-08T10:24:55.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 81578121 0 0) 0x7fa50c003520 con 0x7fa5240d22e0 2024-05-08T10:24:55.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa524146b60 msgr2=0x7fa5240b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:55.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa524146b60 0x7fa5240b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 >> v2:172.21.15.163:3300/0 conn(0x7fa524071db0 msgr2=0x7fa524072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:55.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 --2- 172.21.15.143:0/1839231120 >> v2:172.21.15.163:3300/0 conn(0x7fa524071db0 0x7fa524072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5240b7680 con 0x7fa5240d22e0 2024-05-08T10:24:55.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7fa51c0016f0 con 0x7fa5240d22e0 2024-05-08T10:24:55.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 >> v1:172.21.15.143:6789/0 conn(0x7fa5240d22e0 legacy=0x7fa5240d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa50c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c004800 0x7fa50c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa524146b60 0x7fa50c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5240b73a0 con 0x7fa50c003a00 2024-05-08T10:24:55.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c00b9c0 con 0x7fa50c004800 2024-05-08T10:24:55.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa50c00bbc0 con 0x7fa524146b60 2024-05-08T10:24:55.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa522ffd640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa50c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa5227fc640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c004800 0x7fa50c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa5237fe640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa524146b60 0x7fa50c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa522ffd640 1 -- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa524146b60 msgr2=0x7fa50c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:55.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa522ffd640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa524146b60 0x7fa50c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa522ffd640 1 -- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c004800 msgr2=0x7fa50c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:55.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa522ffd640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c004800 0x7fa50c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa522ffd640 1 -- 172.21.15.143:0/1839231120 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50c003520 con 0x7fa50c003a00 2024-05-08T10:24:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.078+0000 7fa5227fc640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa50c004800 0x7fa50c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.079+0000 7fa522ffd640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa50c003e20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa514009fc0 tx=0x7fa50c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6682127e33e157 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.079+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514009c10 con 0x7fa50c003a00 2024-05-08T10:24:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.079+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa514036070 con 0x7fa50c003a00 2024-05-08T10:24:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.079+0000 7fa521ffb640 1 -- 172.21.15.143:0/1839231120 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514031880 con 0x7fa50c003a00 2024-05-08T10:24:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.080+0000 7fa5298b0640 1 -- 172.21.15.143:0/1839231120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 msgr2=0x7fa50c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.080+0000 7fa5298b0640 1 --2- 172.21.15.143:0/1839231120 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa50c003e20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa514009fc0 tx=0x7fa50c005830 comp rx=0 tx=0).stop 2024-05-08T10:24:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.080+0000 7fa5237fe640 1 -- 172.21.15.143:0/1839231120 reap_dead start 2024-05-08T10:24:55.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.080+0000 7fa5298b0640 1 -- 172.21.15.143:0/1839231120 shutdown_connections 2024-05-08T10:24:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.080+0000 7fa5298b0640 1 -- 172.21.15.143:0/1839231120 >> 172.21.15.143:0/1839231120 conn(0x7fa5240b4da0 msgr2=0x7fa5240b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.080+0000 7fa5298b0640 1 -- 172.21.15.143:0/1839231120 shutdown_connections 2024-05-08T10:24:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.080+0000 7fa5298b0640 1 -- 172.21.15.143:0/1839231120 wait complete. 2024-05-08T10:24:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.081+0000 7fa5298b0640 1 Processor -- start 2024-05-08T10:24:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.081+0000 7fa5298b0640 1 -- start start 2024-05-08T10:24:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa5298b0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa52413d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa5298b0640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa52413ee00 0x7fa52415f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa5298b0640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa52415f690 0x7fa52414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa5298b0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5240d1a70 con 0x7fa50c003a00 2024-05-08T10:24:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa5298b0640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa5240d1dc0 con 0x7fa52415f690 2024-05-08T10:24:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa5298b0640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fa524146f40 con 0x7fa52413ee00 2024-05-08T10:24:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa522ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa52413d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa522ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa52413d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39534/0 (socket says 172.21.15.143:39534) 2024-05-08T10:24:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa522ffd640 1 -- 172.21.15.143:0/3141078374 learned_addr learned my addr 172.21.15.143:0/3141078374 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:55.083 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa5227fc640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa52413ee00 0x7fa52415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa5237fe640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa52415f690 0x7fa52414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa522ffd640 1 -- 172.21.15.143:0/3141078374 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa52413ee00 msgr2=0x7fa52415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa522ffd640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa52413ee00 0x7fa52415f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa522ffd640 1 -- 172.21.15.143:0/3141078374 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa52415f690 msgr2=0x7fa52414db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa522ffd640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa52415f690 0x7fa52414db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa522ffd640 1 -- 172.21.15.143:0/3141078374 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5241f2de0 con 0x7fa50c003a00 2024-05-08T10:24:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa5237fe640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa52415f690 0x7fa52414db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.082+0000 7fa522ffd640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa52413d6a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa514033040 tx=0x7fa514009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.084 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.083+0000 7fa50bfff640 1 -- 172.21.15.143:0/3141078374 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514031e50 con 0x7fa50c003a00 2024-05-08T10:24:55.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.083+0000 7fa50bfff640 1 -- 172.21.15.143:0/3141078374 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa514003990 con 0x7fa50c003a00 2024-05-08T10:24:55.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.083+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa52413dd60 con 0x7fa50c003a00 2024-05-08T10:24:55.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.083+0000 7fa50bfff640 1 -- 172.21.15.143:0/3141078374 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514003d80 con 0x7fa50c003a00 2024-05-08T10:24:55.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.083+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa52413e320 con 0x7fa50c003a00 2024-05-08T10:24:55.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.084+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa52406a4b0 con 0x7fa50c003a00 2024-05-08T10:24:55.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.084+0000 7fa50bfff640 1 -- 172.21.15.143:0/3141078374 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa514005d10 con 0x7fa50c003a00 2024-05-08T10:24:55.085 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.085+0000 7fa50bfff640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa510076470 0x7fa510078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.086 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.085+0000 7fa50bfff640 1 -- 172.21.15.143:0/3141078374 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fa5140b8620 con 0x7fa50c003a00 2024-05-08T10:24:55.086 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.085+0000 7fa5227fc640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa510076470 0x7fa510078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.086 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.085+0000 7fa5227fc640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa510076470 0x7fa510078930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5241406a0 tx=0x7fa518008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.089+0000 7fa50bfff640 1 -- 172.21.15.143:0/3141078374 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa514082280 con 0x7fa50c003a00 2024-05-08T10:24:55.255 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.270+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa524141280 con 0x7fa510076470 2024-05-08T10:24:55.256 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.270+0000 7fa50bfff640 1 -- 172.21.15.143:0/3141078374 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa524141280 con 0x7fa510076470 2024-05-08T10:24:55.256 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T10:24:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa510076470 msgr2=0x7fa510078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa510076470 0x7fa510078930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5241406a0 tx=0x7fa518008040 comp rx=0 tx=0).stop 2024-05-08T10:24:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 msgr2=0x7fa52413d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa52413d6a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa514033040 tx=0x7fa514009750 comp rx=0 tx=0).stop 2024-05-08T10:24:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 shutdown_connections 2024-05-08T10:24:55.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa52415f690 0x7fa52414db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa52413ee00 0x7fa52415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fa510076470 0x7fa510078930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 --2- 172.21.15.143:0/3141078374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c003a00 0x7fa52413d6a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.272+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 >> 172.21.15.143:0/3141078374 conn(0x7fa5240b4da0 msgr2=0x7fa524072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:55.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.273+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 shutdown_connections 2024-05-08T10:24:55.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.273+0000 7fa5298b0640 1 -- 172.21.15.143:0/3141078374 wait complete. 2024-05-08T10:24:55.269 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T10:24:55.269 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:24:55.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.388+0000 7fb000f38640 1 Processor -- start 2024-05-08T10:24:55.373 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.388+0000 7fb000f38640 1 -- start start 2024-05-08T10:24:55.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.388+0000 7fb000f38640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faffc0b0a40 0x7faffc0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7fb000f38640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7faffc071860 0x7faffc0b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7fb000f38640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faffc0b7460 con 0x7faffc0d3b60 2024-05-08T10:24:55.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7fb000f38640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7faffc15d840 con 0x7faffc0b0a40 2024-05-08T10:24:55.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7fb000f38640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7faffc0b1430 con 0x7faffc071860 2024-05-08T10:24:55.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7faffa59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faffc0b0a40 0x7faffc0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.376 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7faff1d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7faffc0d3b60 0x7faffc0b5f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54302/0 (socket says 172.21.15.143:54302) 2024-05-08T10:24:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7faff1d9b640 1 -- 172.21.15.143:0/1769304826 learned_addr learned my addr 172.21.15.143:0/1769304826 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7faffad9d640 1 --2- 172.21.15.143:0/1769304826 >> v2:172.21.15.163:3300/0 conn(0x7faffc071860 0x7faffc0b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7faffa59c640 1 -- 172.21.15.143:0/1769304826 >> v2:172.21.15.163:3300/0 conn(0x7faffc071860 msgr2=0x7faffc0b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7faffa59c640 1 --2- 172.21.15.143:0/1769304826 >> v2:172.21.15.163:3300/0 conn(0x7faffc071860 0x7faffc0b6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7faffa59c640 1 -- 172.21.15.143:0/1769304826 >> v1:172.21.15.143:6789/0 conn(0x7faffc0d3b60 legacy=0x7faffc0b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7faffa59c640 1 -- 172.21.15.143:0/1769304826 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc0b1710 con 0x7faffc0b0a40 2024-05-08T10:24:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.389+0000 7faff9d9b640 1 -- 172.21.15.143:0/1769304826 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352198672 0 0) 0x7faffc0b7460 con 0x7faffc0d3b60 2024-05-08T10:24:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7faffa59c640 1 --2- 172.21.15.143:0/1769304826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc0b0a40 0x7faffc0b0e20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faffc074310 tx=0x7fafec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a4e99911373437 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7faff9d9b640 1 -- 172.21.15.143:0/1769304826 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec037070 con 0x7faffc0b0a40 2024-05-08T10:24:55.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7faff9d9b640 1 -- 172.21.15.143:0/1769304826 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafec032440 con 0x7faffc0b0a40 2024-05-08T10:24:55.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7faff9d9b640 1 -- 172.21.15.143:0/1769304826 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec032810 con 0x7faffc0b0a40 2024-05-08T10:24:55.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7fb000f38640 1 -- 172.21.15.143:0/1769304826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc0b0a40 msgr2=0x7faffc0b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7fb000f38640 1 --2- 172.21.15.143:0/1769304826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc0b0a40 0x7faffc0b0e20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faffc074310 tx=0x7fafec02a1a0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7fb000f38640 1 -- 172.21.15.143:0/1769304826 shutdown_connections 2024-05-08T10:24:55.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7fb000f38640 1 --2- 172.21.15.143:0/1769304826 >> v2:172.21.15.163:3300/0 conn(0x7faffc071860 0x7faffc0b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7fb000f38640 1 --2- 172.21.15.143:0/1769304826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc0b0a40 0x7faffc0b0e20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7fb000f38640 1 -- 172.21.15.143:0/1769304826 >> 172.21.15.143:0/1769304826 conn(0x7faffc0d3040 msgr2=0x7faffc0d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:55.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7fb000f38640 1 -- 172.21.15.143:0/1769304826 shutdown_connections 2024-05-08T10:24:55.379 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.390+0000 7fb000f38640 1 -- 172.21.15.143:0/1769304826 wait complete. 2024-05-08T10:24:55.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.392+0000 7fb000f38640 1 Processor -- start 2024-05-08T10:24:55.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.392+0000 7fb000f38640 1 -- start start 2024-05-08T10:24:55.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7fb000f38640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc071860 0x7faffc15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7fb000f38640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faffc0b0a40 0x7faffc14d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7fb000f38640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faffc0d3b60 0x7faffc14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7fb000f38640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faffc09ca20 con 0x7faffc071860 2024-05-08T10:24:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7fb000f38640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7faffc0b7740 con 0x7faffc0d3b60 2024-05-08T10:24:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7fb000f38640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7faffc09cba0 con 0x7faffc0b0a40 2024-05-08T10:24:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffa59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc071860 0x7faffc15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffa59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc071860 0x7faffc15b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39566/0 (socket says 172.21.15.143:39566) 2024-05-08T10:24:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffa59c640 1 -- 172.21.15.143:0/3290981535 learned_addr learned my addr 172.21.15.143:0/3290981535 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffa59c640 1 -- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faffc0b0a40 msgr2=0x7faffc14d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faff1d9b640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faffc0b0a40 0x7faffc14d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffad9d640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faffc0d3b60 0x7faffc14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffa59c640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faffc0b0a40 0x7faffc14d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffa59c640 1 -- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faffc0d3b60 msgr2=0x7faffc14db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffa59c640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faffc0d3b60 0x7faffc14db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffa59c640 1 -- 172.21.15.143:0/3290981535 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc14e070 con 0x7faffc071860 2024-05-08T10:24:55.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faff1d9b640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faffc0b0a40 0x7faffc14d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:55.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffad9d640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faffc0d3b60 0x7faffc14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:55.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faffa59c640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc071860 0x7faffc15b560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fafec000c00 tx=0x7fafec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faff37fe640 1 -- 172.21.15.143:0/3290981535 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec037040 con 0x7faffc071860 2024-05-08T10:24:55.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faff37fe640 1 -- 172.21.15.143:0/3290981535 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafec042070 con 0x7faffc071860 2024-05-08T10:24:55.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faffc157b40 con 0x7faffc071860 2024-05-08T10:24:55.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7faff37fe640 1 -- 172.21.15.143:0/3290981535 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec030bd0 con 0x7faffc071860 2024-05-08T10:24:55.386 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.393+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faffc158100 con 0x7faffc071860 2024-05-08T10:24:55.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.394+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faffc06a550 con 0x7faffc071860 2024-05-08T10:24:55.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.395+0000 7faff37fe640 1 -- 172.21.15.143:0/3290981535 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fafec047460 con 0x7faffc071860 2024-05-08T10:24:55.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.396+0000 7faff37fe640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fafdc0762d0 0x7fafdc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.396+0000 7faff37fe640 1 -- 172.21.15.143:0/3290981535 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fafec0b8870 con 0x7faffc071860 2024-05-08T10:24:55.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.396+0000 7faff1d9b640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fafdc0762d0 0x7fafdc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.396+0000 7faff37fe640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fafdc07c190 0x7fafdc07e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.396+0000 7faff37fe640 1 -- 172.21.15.143:0/3290981535 --> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafec0067f0 con 0x7fafdc07c190 2024-05-08T10:24:55.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.396+0000 7faff37fe640 1 -- 172.21.15.143:0/3290981535 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fafec0b8d00 con 0x7faffc071860 2024-05-08T10:24:55.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.396+0000 7faff1d9b640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fafdc0762d0 0x7fafdc078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faffc15af90 tx=0x7fafe4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.396+0000 7faffad9d640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fafdc07c190 0x7fafdc07e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.396+0000 7faffad9d640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fafdc07c190 0x7fafdc07e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.397+0000 7faff37fe640 1 -- 172.21.15.143:0/3290981535 <== osd.5 v2:172.21.15.163:6800/688232145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafec0067f0 con 0x7fafdc07c190 2024-05-08T10:24:55.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.410+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 --> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faffc09c290 con 0x7fafdc07c190 2024-05-08T10:24:55.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7faff37fe640 1 -- 172.21.15.143:0/3290981535 <== osd.5 v2:172.21.15.163:6800/688232145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faffc09c290 con 0x7fafdc07c190 2024-05-08T10:24:55.396 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:55.397 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:24:55.397 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:55.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fafdc07c190 msgr2=0x7fafdc07e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.163:6800/688232145,v1:172.21.15.163:6801/688232145] conn(0x7fafdc07c190 0x7fafdc07e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fafdc0762d0 msgr2=0x7fafdc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fafdc0762d0 0x7fafdc078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faffc15af90 tx=0x7fafe4009040 comp rx=0 tx=0).stop 2024-05-08T10:24:55.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc071860 msgr2=0x7faffc15b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 --2- 172.21.15.143:0/3290981535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faffc071860 0x7faffc15b560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fafec000c00 tx=0x7fafec0046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7faffad9d640 1 -- 172.21.15.143:0/3290981535 reap_dead start 2024-05-08T10:24:55.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 shutdown_connections 2024-05-08T10:24:55.399 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 >> 172.21.15.143:0/3290981535 conn(0x7faffc0d3040 msgr2=0x7faffc0b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:55.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 shutdown_connections 2024-05-08T10:24:55.400 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.411+0000 7fb000f38640 1 -- 172.21.15.143:0/3290981535 wait complete. 2024-05-08T10:24:55.407 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T10:24:55.508 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.523+0000 7f4454c1d640 1 Processor -- start 2024-05-08T10:24:55.509 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.523+0000 7f4454c1d640 1 -- start start 2024-05-08T10:24:55.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.524+0000 7f4454c1d640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4450073b90 0x7f44500b5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.524+0000 7f4454c1d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44500afd50 con 0x7f44500b4f30 2024-05-08T10:24:55.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.524+0000 7f4454c1d640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f445015c530 con 0x7f445015c150 2024-05-08T10:24:55.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.524+0000 7f4454c1d640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f44500afff0 con 0x7f4450073b90 2024-05-08T10:24:55.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.524+0000 7f444dd9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f44500b4f30 0x7f4450073480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54308/0 (socket says 172.21.15.143:54308) 2024-05-08T10:24:55.511 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.524+0000 7f444dd9b640 1 -- 172.21.15.143:0/3234512642 learned_addr learned my addr 172.21.15.143:0/3234512642 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:55.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.525+0000 7f444ed9d640 1 --2- 172.21.15.143:0/3234512642 >> v2:172.21.15.163:3300/0 conn(0x7f4450073b90 0x7f44500b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.525+0000 7f444d59a640 1 -- 172.21.15.143:0/3234512642 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80353872 0 0) 0x7f44500afd50 con 0x7f44500b4f30 2024-05-08T10:24:55.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.525+0000 7f444d59a640 1 -- 172.21.15.143:0/3234512642 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4438003520 con 0x7f44500b4f30 2024-05-08T10:24:55.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.525+0000 7f444ed9d640 1 -- 172.21.15.143:0/3234512642 >> v1:172.21.15.163:6789/0 conn(0x7f445015c150 legacy=0x7f44500b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.525+0000 7f444ed9d640 1 -- 172.21.15.143:0/3234512642 >> v1:172.21.15.143:6789/0 conn(0x7f44500b4f30 legacy=0x7f4450073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.525+0000 7f444ed9d640 1 -- 172.21.15.143:0/3234512642 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44500b02d0 con 0x7f4450073b90 2024-05-08T10:24:55.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.526+0000 7f444ed9d640 1 --2- 172.21.15.143:0/3234512642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4450073b90 0x7f44500b5360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4448009d90 tx=0x7f444802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e7a481d2241bb02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.512 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.526+0000 7f444d59a640 1 -- 172.21.15.143:0/3234512642 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448007740 con 0x7f4450073b90 2024-05-08T10:24:55.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.526+0000 7f444d59a640 1 -- 172.21.15.143:0/3234512642 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44480078e0 con 0x7f4450073b90 2024-05-08T10:24:55.513 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.526+0000 7f444d59a640 1 -- 172.21.15.143:0/3234512642 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448007c90 con 0x7f4450073b90 2024-05-08T10:24:55.516 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.526+0000 7f4454c1d640 1 -- 172.21.15.143:0/3234512642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4450073b90 msgr2=0x7f44500b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.526+0000 7f4454c1d640 1 --2- 172.21.15.143:0/3234512642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4450073b90 0x7f44500b5360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4448009d90 tx=0x7f444802a6f0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.527+0000 7f4454c1d640 1 -- 172.21.15.143:0/3234512642 shutdown_connections 2024-05-08T10:24:55.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.527+0000 7f4454c1d640 1 --2- 172.21.15.143:0/3234512642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4450073b90 0x7f44500b5360 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.527+0000 7f4454c1d640 1 -- 172.21.15.143:0/3234512642 >> 172.21.15.143:0/3234512642 conn(0x7f44500b3c30 msgr2=0x7f44500b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:55.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.527+0000 7f4454c1d640 1 -- 172.21.15.143:0/3234512642 shutdown_connections 2024-05-08T10:24:55.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.527+0000 7f4454c1d640 1 -- 172.21.15.143:0/3234512642 wait complete. 2024-05-08T10:24:55.517 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.528+0000 7f4454c1d640 1 Processor -- start 2024-05-08T10:24:55.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.528+0000 7f4454c1d640 1 -- start start 2024-05-08T10:24:55.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f4454c1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4450073b90 0x7f4450150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f4454c1d640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f44500b4f30 0x7f4450142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f4454c1d640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445015c150 0x7f445015c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f4454c1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f44500b14c0 con 0x7f4450073b90 2024-05-08T10:24:55.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f4454c1d640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f44500b0890 con 0x7f445015c150 2024-05-08T10:24:55.518 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f4454c1d640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f44500b1640 con 0x7f44500b4f30 2024-05-08T10:24:55.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4450073b90 0x7f4450150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4450073b90 0x7f4450150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39578/0 (socket says 172.21.15.143:39578) 2024-05-08T10:24:55.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444e59c640 1 -- 172.21.15.143:0/4107348111 learned_addr learned my addr 172.21.15.143:0/4107348111 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:55.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444dd9b640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f44500b4f30 0x7f4450142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444ed9d640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445015c150 0x7f445015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444e59c640 1 -- 172.21.15.143:0/4107348111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f44500b4f30 msgr2=0x7f4450142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444e59c640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f44500b4f30 0x7f4450142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.519 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444e59c640 1 -- 172.21.15.143:0/4107348111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445015c150 msgr2=0x7f445015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444e59c640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445015c150 0x7f445015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444e59c640 1 -- 172.21.15.143:0/4107348111 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4450151030 con 0x7f4450073b90 2024-05-08T10:24:55.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444ed9d640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445015c150 0x7f445015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:55.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f444e59c640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4450073b90 0x7f4450150740 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f444000c370 tx=0x7f444000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f443effd640 1 -- 172.21.15.143:0/4107348111 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44400052d0 con 0x7f4450073b90 2024-05-08T10:24:55.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f443effd640 1 -- 172.21.15.143:0/4107348111 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4440007020 con 0x7f4450073b90 2024-05-08T10:24:55.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4450148250 con 0x7f4450073b90 2024-05-08T10:24:55.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f443effd640 1 -- 172.21.15.143:0/4107348111 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44400054b0 con 0x7f4450073b90 2024-05-08T10:24:55.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.529+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4450150c80 con 0x7f4450073b90 2024-05-08T10:24:55.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.530+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445006a4b0 con 0x7f4450073b90 2024-05-08T10:24:55.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.531+0000 7f443effd640 1 -- 172.21.15.143:0/4107348111 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4440007410 con 0x7f4450073b90 2024-05-08T10:24:55.523 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.532+0000 7f443effd640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4430076300 0x7f44300787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.523 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.532+0000 7f443effd640 1 -- 172.21.15.143:0/4107348111 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f44400966f0 con 0x7f4450073b90 2024-05-08T10:24:55.523 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.532+0000 7f444dd9b640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4430076300 0x7f44300787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.532+0000 7f444dd9b640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4430076300 0x7f44300787c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4444007a60 tx=0x7f4444009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.524 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.536+0000 7f443effd640 1 -- 172.21.15.143:0/4107348111 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4440060350 con 0x7f4450073b90 2024-05-08T10:24:55.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.718+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f445015fa50 con 0x7f4430076300 2024-05-08T10:24:55.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.718+0000 7f443effd640 1 -- 172.21.15.143:0/4107348111 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f445015fa50 con 0x7f4430076300 2024-05-08T10:24:55.704 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T10:24:55.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4430076300 msgr2=0x7f44300787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4430076300 0x7f44300787c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4444007a60 tx=0x7f4444009040 comp rx=0 tx=0).stop 2024-05-08T10:24:55.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4450073b90 msgr2=0x7f4450150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4450073b90 0x7f4450150740 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f444000c370 tx=0x7f444000c830 comp rx=0 tx=0).stop 2024-05-08T10:24:55.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 shutdown_connections 2024-05-08T10:24:55.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445015c150 0x7f445015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f44500b4f30 0x7f4450142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f4430076300 0x7f44300787c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 --2- 172.21.15.143:0/4107348111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4450073b90 0x7f4450150740 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.720+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 >> 172.21.15.143:0/4107348111 conn(0x7f44500b3c30 msgr2=0x7f44501676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:55.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.721+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 shutdown_connections 2024-05-08T10:24:55.707 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.721+0000 7f4454c1d640 1 -- 172.21.15.143:0/4107348111 wait complete. 2024-05-08T10:24:55.716 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T10:24:55.717 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:24:55.819 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.834+0000 7fb8f4571640 1 Processor -- start 2024-05-08T10:24:55.820 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.834+0000 7fb8f4571640 1 -- start start 2024-05-08T10:24:55.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.835+0000 7fb8f4571640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb8ec0b4e60 0x7fb8ec0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.835+0000 7fb8f4571640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb8ec0b0000 0x7fb8ec06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.821 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.835+0000 7fb8f4571640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec0ae160 con 0x7fb8ec1578e0 2024-05-08T10:24:55.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.835+0000 7fb8f4571640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ec0b4410 con 0x7fb8ec0b4e60 2024-05-08T10:24:55.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.835+0000 7fb8f4571640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ec0ae420 con 0x7fb8ec0b0000 2024-05-08T10:24:55.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.835+0000 7fb8f1b0c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb8ec0b4e60 0x7fb8ec0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.835+0000 7fb8f230d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb8ec1578e0 0x7fb8ec15e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54316/0 (socket says 172.21.15.143:54316) 2024-05-08T10:24:55.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.835+0000 7fb8f230d640 1 -- 172.21.15.143:0/1042614024 learned_addr learned my addr 172.21.15.143:0/1042614024 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:55.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.835+0000 7fb8f2b0e640 1 --2- 172.21.15.143:0/1042614024 >> v2:172.21.15.163:3300/0 conn(0x7fb8ec0b0000 0x7fb8ec06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.836+0000 7fb8f1b0c640 1 -- 172.21.15.143:0/1042614024 >> v2:172.21.15.163:3300/0 conn(0x7fb8ec0b0000 msgr2=0x7fb8ec06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:55.822 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.836+0000 7fb8f1b0c640 1 --2- 172.21.15.143:0/1042614024 >> v2:172.21.15.163:3300/0 conn(0x7fb8ec0b0000 0x7fb8ec06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.836+0000 7fb8f1b0c640 1 -- 172.21.15.143:0/1042614024 >> v1:172.21.15.143:6789/0 conn(0x7fb8ec1578e0 legacy=0x7fb8ec15e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.836+0000 7fb8f130b640 1 -- 172.21.15.143:0/1042614024 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4114172439 0 0) 0x7fb8ec0ae160 con 0x7fb8ec1578e0 2024-05-08T10:24:55.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.836+0000 7fb8f1b0c640 1 -- 172.21.15.143:0/1042614024 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec0b4660 con 0x7fb8ec0b4e60 2024-05-08T10:24:55.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.836+0000 7fb8f1b0c640 1 --2- 172.21.15.143:0/1042614024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b4e60 0x7fb8ec0afac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0d0d30 tx=0x7fb8dc02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71d398d62e8d46c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.836+0000 7fb8f130b640 1 -- 172.21.15.143:0/1042614024 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc037070 con 0x7fb8ec0b4e60 2024-05-08T10:24:55.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.836+0000 7fb8f130b640 1 -- 172.21.15.143:0/1042614024 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8dc02add0 con 0x7fb8ec0b4e60 2024-05-08T10:24:55.823 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.836+0000 7fb8f130b640 1 -- 172.21.15.143:0/1042614024 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc032660 con 0x7fb8ec0b4e60 2024-05-08T10:24:55.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.837+0000 7fb8f4571640 1 -- 172.21.15.143:0/1042614024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b4e60 msgr2=0x7fb8ec0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.837+0000 7fb8f4571640 1 --2- 172.21.15.143:0/1042614024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b4e60 0x7fb8ec0afac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0d0d30 tx=0x7fb8dc02a080 comp rx=0 tx=0).stop 2024-05-08T10:24:55.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.837+0000 7fb8f4571640 1 -- 172.21.15.143:0/1042614024 shutdown_connections 2024-05-08T10:24:55.826 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.837+0000 7fb8f4571640 1 --2- 172.21.15.143:0/1042614024 >> v2:172.21.15.163:3300/0 conn(0x7fb8ec0b0000 0x7fb8ec06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.837+0000 7fb8f4571640 1 --2- 172.21.15.143:0/1042614024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b4e60 0x7fb8ec0afac0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.837+0000 7fb8f4571640 1 -- 172.21.15.143:0/1042614024 >> 172.21.15.143:0/1042614024 conn(0x7fb8ec0b2b40 msgr2=0x7fb8ec0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:55.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.837+0000 7fb8f4571640 1 -- 172.21.15.143:0/1042614024 shutdown_connections 2024-05-08T10:24:55.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.837+0000 7fb8f4571640 1 -- 172.21.15.143:0/1042614024 wait complete. 2024-05-08T10:24:55.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.838+0000 7fb8f4571640 1 Processor -- start 2024-05-08T10:24:55.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.838+0000 7fb8f4571640 1 -- start start 2024-05-08T10:24:55.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f4571640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b0000 0x7fb8ec145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.827 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f4571640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8ec0b4e60 0x7fb8ec1601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f4571640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8ec1578e0 0x7fb8ec06e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f4571640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec0b0410 con 0x7fb8ec0b0000 2024-05-08T10:24:55.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f4571640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec0ade20 con 0x7fb8ec0b4e60 2024-05-08T10:24:55.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f4571640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ec0b6260 con 0x7fb8ec1578e0 2024-05-08T10:24:55.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f230d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b0000 0x7fb8ec145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f230d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b0000 0x7fb8ec145830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39594/0 (socket says 172.21.15.143:39594) 2024-05-08T10:24:55.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f230d640 1 -- 172.21.15.143:0/122539011 learned_addr learned my addr 172.21.15.143:0/122539011 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:55.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f230d640 1 -- 172.21.15.143:0/122539011 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8ec1578e0 msgr2=0x7fb8ec06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f230d640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8ec1578e0 0x7fb8ec06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f230d640 1 -- 172.21.15.143:0/122539011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8ec0b4e60 msgr2=0x7fb8ec1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f230d640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8ec0b4e60 0x7fb8ec1601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.839+0000 7fb8f230d640 1 -- 172.21.15.143:0/122539011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec145d70 con 0x7fb8ec0b0000 2024-05-08T10:24:55.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.840+0000 7fb8f230d640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b0000 0x7fb8ec145830 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8001220 tx=0x7fb8e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.840+0000 7fb8e2ffd640 1 -- 172.21.15.143:0/122539011 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8017070 con 0x7fb8ec0b0000 2024-05-08T10:24:55.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.840+0000 7fb8e2ffd640 1 -- 172.21.15.143:0/122539011 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e8005da0 con 0x7fb8ec0b0000 2024-05-08T10:24:55.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.840+0000 7fb8e2ffd640 1 -- 172.21.15.143:0/122539011 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80072b0 con 0x7fb8ec0b0000 2024-05-08T10:24:55.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.840+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ec1606f0 con 0x7fb8ec0b0000 2024-05-08T10:24:55.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.840+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ec09c290 con 0x7fb8ec0b0000 2024-05-08T10:24:55.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.841+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8ec06a550 con 0x7fb8ec0b0000 2024-05-08T10:24:55.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.841+0000 7fb8e2ffd640 1 -- 172.21.15.143:0/122539011 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb8e801a070 con 0x7fb8ec0b0000 2024-05-08T10:24:55.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.842+0000 7fb8e2ffd640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb8d00762d0 0x7fb8d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.842+0000 7fb8e2ffd640 1 -- 172.21.15.143:0/122539011 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fb8e80965e0 con 0x7fb8ec0b0000 2024-05-08T10:24:55.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.842+0000 7fb8f1b0c640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb8d00762d0 0x7fb8d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.842+0000 7fb8e2ffd640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fb8d007c190 0x7fb8d007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.842+0000 7fb8e2ffd640 1 -- 172.21.15.143:0/122539011 --> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8d007ec60 con 0x7fb8d007c190 2024-05-08T10:24:55.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.842+0000 7fb8e2ffd640 1 -- 172.21.15.143:0/122539011 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb8e809d050 con 0x7fb8ec0b0000 2024-05-08T10:24:55.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.842+0000 7fb8f1b0c640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb8d00762d0 0x7fb8d0078790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc034000 tx=0x7fb8dc02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.842+0000 7fb8f2b0e640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fb8d007c190 0x7fb8d007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.843+0000 7fb8f2b0e640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fb8d007c190 0x7fb8d007e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.832 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.843+0000 7fb8e2ffd640 1 -- 172.21.15.143:0/122539011 <== osd.6 v2:172.21.15.163:6824/2263704478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb8d007ec60 con 0x7fb8d007c190 2024-05-08T10:24:55.841 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.856+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 --> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb8ec152e90 con 0x7fb8d007c190 2024-05-08T10:24:55.842 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8e2ffd640 1 -- 172.21.15.143:0/122539011 <== osd.6 v2:172.21.15.163:6824/2263704478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb8ec152e90 con 0x7fb8d007c190 2024-05-08T10:24:55.842 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:55.842 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:24:55.842 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fb8d007c190 msgr2=0x7fb8d007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.843 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8f4571640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.163:6824/2263704478,v1:172.21.15.163:6825/2263704478] conn(0x7fb8d007c190 0x7fb8d007e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb8d00762d0 msgr2=0x7fb8d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8f4571640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7fb8d00762d0 0x7fb8d0078790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc034000 tx=0x7fb8dc02c000 comp rx=0 tx=0).stop 2024-05-08T10:24:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b0000 msgr2=0x7fb8ec145830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8f4571640 1 --2- 172.21.15.143:0/122539011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ec0b0000 0x7fb8ec145830 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8001220 tx=0x7fb8e800c960 comp rx=0 tx=0).stop 2024-05-08T10:24:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8f2b0e640 1 -- 172.21.15.143:0/122539011 reap_dead start 2024-05-08T10:24:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 shutdown_connections 2024-05-08T10:24:55.844 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.857+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 >> 172.21.15.143:0/122539011 conn(0x7fb8ec0b2b40 msgr2=0x7fb8ec156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:55.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.858+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 shutdown_connections 2024-05-08T10:24:55.845 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.858+0000 7fb8f4571640 1 -- 172.21.15.143:0/122539011 wait complete. 2024-05-08T10:24:55.853 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T10:24:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.969+0000 7f64d6617640 1 Processor -- start 2024-05-08T10:24:55.954 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.969+0000 7f64d6617640 1 -- start start 2024-05-08T10:24:55.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.969+0000 7f64d6617640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f64d015f350 0x7f64d00bace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.969+0000 7f64d6617640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 0x7f64d00d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.969+0000 7f64d6617640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64d00bb220 con 0x7f64d00b8240 2024-05-08T10:24:55.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.969+0000 7f64d6617640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f64d00b9670 con 0x7f64d015f350 2024-05-08T10:24:55.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.969+0000 7f64d6617640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f64d00b8a60 con 0x7f64d00d2250 2024-05-08T10:24:55.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64cffff640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f64d015f350 0x7f64d00bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.956 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64d4bb4640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 0x7f64d00d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64cffff640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f64d015f350 0x7f64d00bace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.143:39240/0 (socket says 172.21.15.143:39240) 2024-05-08T10:24:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64cffff640 1 -- 172.21.15.143:0/1987842742 learned_addr learned my addr 172.21.15.143:0/1987842742 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64c7fff640 1 --1- 172.21.15.143:0/1987842742 >> v1:172.21.15.163:6789/0 conn(0x7f64d00b8240 0x7f64d00d3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.143:47268/0 (socket says 172.21.15.143:47268) 2024-05-08T10:24:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64cffff640 1 -- 172.21.15.143:0/1987842742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 msgr2=0x7f64d00d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64cffff640 1 --2- 172.21.15.143:0/1987842742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 0x7f64d00d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64cffff640 1 -- 172.21.15.143:0/1987842742 >> v1:172.21.15.163:6789/0 conn(0x7f64d00b8240 legacy=0x7f64d00d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64cffff640 1 -- 172.21.15.143:0/1987842742 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d00b8d40 con 0x7f64d015f350 2024-05-08T10:24:55.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.970+0000 7f64d4bb4640 1 --2- 172.21.15.143:0/1987842742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 0x7f64d00d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.971+0000 7f64cffff640 1 --2- 172.21.15.143:0/1987842742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64d015f350 0x7f64d00bace0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009870 tx=0x7f64c002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b163ee956a16216 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.971+0000 7f64cf7fe640 1 -- 172.21.15.143:0/1987842742 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0037070 con 0x7f64d015f350 2024-05-08T10:24:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.971+0000 7f64cf7fe640 1 -- 172.21.15.143:0/1987842742 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c002ae50 con 0x7f64d015f350 2024-05-08T10:24:55.958 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.971+0000 7f64cf7fe640 1 -- 172.21.15.143:0/1987842742 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0032860 con 0x7f64d015f350 2024-05-08T10:24:55.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.972+0000 7f64d6617640 1 -- 172.21.15.143:0/1987842742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64d015f350 msgr2=0x7f64d00bace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.972+0000 7f64d6617640 1 --2- 172.21.15.143:0/1987842742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64d015f350 0x7f64d00bace0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009870 tx=0x7f64c002a300 comp rx=0 tx=0).stop 2024-05-08T10:24:55.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.972+0000 7f64d6617640 1 -- 172.21.15.143:0/1987842742 shutdown_connections 2024-05-08T10:24:55.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.972+0000 7f64d6617640 1 --2- 172.21.15.143:0/1987842742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 0x7f64d00d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.972+0000 7f64d6617640 1 --2- 172.21.15.143:0/1987842742 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64d015f350 0x7f64d00bace0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.972+0000 7f64d6617640 1 -- 172.21.15.143:0/1987842742 >> 172.21.15.143:0/1987842742 conn(0x7f64d0073e70 msgr2=0x7f64d0074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:55.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.972+0000 7f64d6617640 1 -- 172.21.15.143:0/1987842742 shutdown_connections 2024-05-08T10:24:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.972+0000 7f64d6617640 1 -- 172.21.15.143:0/1987842742 wait complete. 2024-05-08T10:24:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.973+0000 7f64d6617640 1 Processor -- start 2024-05-08T10:24:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.973+0000 7f64d6617640 1 -- start start 2024-05-08T10:24:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.973+0000 7f64d6617640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64d00b8240 0x7f64d0160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.973+0000 7f64d6617640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 0x7f64d015e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.973+0000 7f64d6617640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64d015f350 0x7f64d0161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.973+0000 7f64d6617640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f64d015f730 con 0x7f64d015f350 2024-05-08T10:24:55.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d6617640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f64d00b9300 con 0x7f64d00b8240 2024-05-08T10:24:55.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d6617640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f64d00b86d0 con 0x7f64d00d2250 2024-05-08T10:24:55.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d4bb4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64d015f350 0x7f64d0161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d4bb4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64d015f350 0x7f64d0161630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39608/0 (socket says 172.21.15.143:39608) 2024-05-08T10:24:55.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d4bb4640 1 -- 172.21.15.143:0/17902236 learned_addr learned my addr 172.21.15.143:0/17902236 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:55.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64cffff640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64d00b8240 0x7f64d0160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64c7fff640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 0x7f64d015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d4bb4640 1 -- 172.21.15.143:0/17902236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 msgr2=0x7f64d015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.963 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d4bb4640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 0x7f64d015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d4bb4640 1 -- 172.21.15.143:0/17902236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64d00b8240 msgr2=0x7f64d0160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:55.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d4bb4640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64d00b8240 0x7f64d0160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:55.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d4bb4640 1 -- 172.21.15.143:0/17902236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d01f5280 con 0x7f64d015f350 2024-05-08T10:24:55.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d4bb4640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64d015f350 0x7f64d0161630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f64c800efc0 tx=0x7f64c8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64cd7fa640 1 -- 172.21.15.143:0/17902236 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c8018030 con 0x7f64d015f350 2024-05-08T10:24:55.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64cd7fa640 1 -- 172.21.15.143:0/17902236 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c800cde0 con 0x7f64d015f350 2024-05-08T10:24:55.964 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64cd7fa640 1 -- 172.21.15.143:0/17902236 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c8003bb0 con 0x7f64d015f350 2024-05-08T10:24:55.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d0161da0 con 0x7f64d015f350 2024-05-08T10:24:55.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.974+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d0162360 con 0x7f64d015f350 2024-05-08T10:24:55.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.975+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64d006a4b0 con 0x7f64d015f350 2024-05-08T10:24:55.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.976+0000 7f64cd7fa640 1 -- 172.21.15.143:0/17902236 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f64c8005d10 con 0x7f64d015f350 2024-05-08T10:24:55.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.976+0000 7f64cd7fa640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f64b00762d0 0x7f64b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:55.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.976+0000 7f64cd7fa640 1 -- 172.21.15.143:0/17902236 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f64c8097bb0 con 0x7f64d015f350 2024-05-08T10:24:55.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.976+0000 7f64cffff640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f64b00762d0 0x7f64b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:55.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.977+0000 7f64cffff640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f64b00762d0 0x7f64b0078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f64c0034000 tx=0x7f64c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:55.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:55.981+0000 7f64cd7fa640 1 -- 172.21.15.143:0/17902236 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f64c8022070 con 0x7f64d015f350 2024-05-08T10:24:56.147 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.162+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f64d00d29a0 con 0x7f64b00762d0 2024-05-08T10:24:56.148 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.163+0000 7f64cd7fa640 1 -- 172.21.15.143:0/17902236 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f64d00d29a0 con 0x7f64b00762d0 2024-05-08T10:24:56.148 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T10:24:56.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.164+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f64b00762d0 msgr2=0x7f64b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.164+0000 7f64d6617640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f64b00762d0 0x7f64b0078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f64c0034000 tx=0x7f64c002e000 comp rx=0 tx=0).stop 2024-05-08T10:24:56.150 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.164+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64d015f350 msgr2=0x7f64d0161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.164+0000 7f64d6617640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64d015f350 0x7f64d0161630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f64c800efc0 tx=0x7f64c8009f90 comp rx=0 tx=0).stop 2024-05-08T10:24:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.165+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 shutdown_connections 2024-05-08T10:24:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.165+0000 7f64d6617640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f64b00762d0 0x7f64b0078790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.165+0000 7f64d6617640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f64d015f350 0x7f64d0161630 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.165+0000 7f64d6617640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f64d00d2250 0x7f64d015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.165+0000 7f64d6617640 1 --2- 172.21.15.143:0/17902236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f64d00b8240 0x7f64d0160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.151 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.165+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 >> 172.21.15.143:0/17902236 conn(0x7f64d0073e70 msgr2=0x7f64d00d3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:56.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.165+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 shutdown_connections 2024-05-08T10:24:56.152 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.165+0000 7f64d6617640 1 -- 172.21.15.143:0/17902236 wait complete. 2024-05-08T10:24:56.161 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T10:24:56.161 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:24:56.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.280+0000 7f9b24615640 1 Processor -- start 2024-05-08T10:24:56.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.280+0000 7f9b24615640 1 -- start start 2024-05-08T10:24:56.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b24615640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9b1c1608b0 0x7f9b1c0b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b24615640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9b1c068110 0x7f9b1c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b24615640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b1c06fe60 con 0x7f9b1c06f8b0 2024-05-08T10:24:56.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b24615640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9b1c06c320 con 0x7f9b1c1608b0 2024-05-08T10:24:56.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b24615640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f9b1c0cf850 con 0x7f9b1c068110 2024-05-08T10:24:56.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b223b1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9b1c1608b0 0x7f9b1c0b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b223b1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9b1c1608b0 0x7f9b1c0b6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39610/0 (socket says 172.21.15.143:39610) 2024-05-08T10:24:56.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b22bb2640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9b1c06f8b0 0x7f9b1c160df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54326/0 (socket says 172.21.15.143:54326) 2024-05-08T10:24:56.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b223b1640 1 -- 172.21.15.143:0/2690007746 learned_addr learned my addr 172.21.15.143:0/2690007746 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:56.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b21bb0640 1 --2- 172.21.15.143:0/2690007746 >> v2:172.21.15.163:3300/0 conn(0x7f9b1c068110 0x7f9b1c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b223b1640 1 -- 172.21.15.143:0/2690007746 >> v2:172.21.15.163:3300/0 conn(0x7f9b1c068110 msgr2=0x7f9b1c0b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b223b1640 1 --2- 172.21.15.143:0/2690007746 >> v2:172.21.15.163:3300/0 conn(0x7f9b1c068110 0x7f9b1c0b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b223b1640 1 -- 172.21.15.143:0/2690007746 >> v1:172.21.15.143:6789/0 conn(0x7f9b1c06f8b0 legacy=0x7f9b1c160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b223b1640 1 -- 172.21.15.143:0/2690007746 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c0cfb30 con 0x7f9b1c1608b0 2024-05-08T10:24:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b213af640 1 -- 172.21.15.143:0/2690007746 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924999787 0 0) 0x7f9b1c06fe60 con 0x7f9b1c06f8b0 2024-05-08T10:24:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.281+0000 7f9b21bb0640 1 --2- 172.21.15.143:0/2690007746 >> v2:172.21.15.163:3300/0 conn(0x7f9b1c068110 0x7f9b1c0b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:56.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.282+0000 7f9b223b1640 1 --2- 172.21.15.143:0/2690007746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c1608b0 0x7f9b1c0b6c70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c064080 tx=0x7f9b1802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd0f37df7014133 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.282+0000 7f9b213af640 1 -- 172.21.15.143:0/2690007746 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18037070 con 0x7f9b1c1608b0 2024-05-08T10:24:56.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.282+0000 7f9b213af640 1 -- 172.21.15.143:0/2690007746 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b18032440 con 0x7f9b1c1608b0 2024-05-08T10:24:56.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.282+0000 7f9b213af640 1 -- 172.21.15.143:0/2690007746 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18032810 con 0x7f9b1c1608b0 2024-05-08T10:24:56.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.283+0000 7f9b24615640 1 -- 172.21.15.143:0/2690007746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c1608b0 msgr2=0x7f9b1c0b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.283+0000 7f9b24615640 1 --2- 172.21.15.143:0/2690007746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c1608b0 0x7f9b1c0b6c70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c064080 tx=0x7f9b1802a1e0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.283+0000 7f9b24615640 1 -- 172.21.15.143:0/2690007746 shutdown_connections 2024-05-08T10:24:56.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.283+0000 7f9b24615640 1 --2- 172.21.15.143:0/2690007746 >> v2:172.21.15.163:3300/0 conn(0x7f9b1c068110 0x7f9b1c0b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.283+0000 7f9b24615640 1 --2- 172.21.15.143:0/2690007746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c1608b0 0x7f9b1c0b6c70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.283+0000 7f9b24615640 1 -- 172.21.15.143:0/2690007746 >> 172.21.15.143:0/2690007746 conn(0x7f9b1c0cf2a0 msgr2=0x7f9b1c072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:56.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.283+0000 7f9b24615640 1 -- 172.21.15.143:0/2690007746 shutdown_connections 2024-05-08T10:24:56.272 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.283+0000 7f9b24615640 1 -- 172.21.15.143:0/2690007746 wait complete. 2024-05-08T10:24:56.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.284+0000 7f9b24615640 1 Processor -- start 2024-05-08T10:24:56.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.284+0000 7f9b24615640 1 -- start start 2024-05-08T10:24:56.276 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b24615640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c068110 0x7f9b1c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b24615640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b1c06f8b0 0x7f9b1c13a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b24615640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c1608b0 0x7f9b1c13ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b24615640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0b1160 con 0x7f9b1c068110 2024-05-08T10:24:56.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b24615640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0b0fe0 con 0x7f9b1c1608b0 2024-05-08T10:24:56.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b24615640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c06d7c0 con 0x7f9b1c06f8b0 2024-05-08T10:24:56.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b223b1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c068110 0x7f9b1c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b223b1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c068110 0x7f9b1c1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39626/0 (socket says 172.21.15.143:39626) 2024-05-08T10:24:56.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b223b1640 1 -- 172.21.15.143:0/3421621318 learned_addr learned my addr 172.21.15.143:0/3421621318 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:56.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b21bb0640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b1c06f8b0 0x7f9b1c13a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b22bb2640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c1608b0 0x7f9b1c13ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b223b1640 1 -- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b1c06f8b0 msgr2=0x7f9b1c13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b223b1640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b1c06f8b0 0x7f9b1c13a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b223b1640 1 -- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c1608b0 msgr2=0x7f9b1c13ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b223b1640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c1608b0 0x7f9b1c13ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.278 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b223b1640 1 -- 172.21.15.143:0/3421621318 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c153a00 con 0x7f9b1c068110 2024-05-08T10:24:56.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b22bb2640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c1608b0 0x7f9b1c13ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:24:56.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b223b1640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c068110 0x7f9b1c1520d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9b180090b0 tx=0x7f9b180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b12ffd640 1 -- 172.21.15.143:0/3421621318 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18037040 con 0x7f9b1c068110 2024-05-08T10:24:56.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b12ffd640 1 -- 172.21.15.143:0/3421621318 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b18004230 con 0x7f9b1c068110 2024-05-08T10:24:56.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1c152960 con 0x7f9b1c068110 2024-05-08T10:24:56.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b12ffd640 1 -- 172.21.15.143:0/3421621318 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18003610 con 0x7f9b1c068110 2024-05-08T10:24:56.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.285+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b1c152f20 con 0x7f9b1c068110 2024-05-08T10:24:56.279 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.286+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b1c06a550 con 0x7f9b1c068110 2024-05-08T10:24:56.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.287+0000 7f9b12ffd640 1 -- 172.21.15.143:0/3421621318 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9b180037b0 con 0x7f9b1c068110 2024-05-08T10:24:56.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.287+0000 7f9b12ffd640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9b000762d0 0x7f9b00078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.288+0000 7f9b21bb0640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9b000762d0 0x7f9b00078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.288+0000 7f9b12ffd640 1 -- 172.21.15.143:0/3421621318 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f9b180b8960 con 0x7f9b1c068110 2024-05-08T10:24:56.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.288+0000 7f9b12ffd640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f9b0007c190 0x7f9b0007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.288+0000 7f9b12ffd640 1 -- 172.21.15.143:0/3421621318 --> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b18032440 con 0x7f9b0007c190 2024-05-08T10:24:56.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.288+0000 7f9b12ffd640 1 -- 172.21.15.143:0/3421621318 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9b180b8df0 con 0x7f9b1c068110 2024-05-08T10:24:56.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.288+0000 7f9b21bb0640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9b000762d0 0x7f9b00078790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c141ed0 tx=0x7f9b0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.288+0000 7f9b22bb2640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f9b0007c190 0x7f9b0007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.289+0000 7f9b22bb2640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f9b0007c190 0x7f9b0007e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.281 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.289+0000 7f9b12ffd640 1 -- 172.21.15.143:0/3421621318 <== osd.7 v2:172.21.15.163:6816/4102156474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b18032440 con 0x7f9b0007c190 2024-05-08T10:24:56.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.302+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 --> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9b1c0b0ab0 con 0x7f9b0007c190 2024-05-08T10:24:56.287 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.302+0000 7f9b12ffd640 1 -- 172.21.15.143:0/3421621318 <== osd.7 v2:172.21.15.163:6816/4102156474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9b1c0b0ab0 con 0x7f9b0007c190 2024-05-08T10:24:56.288 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-05-08T10:24:56.288 INFO:teuthology.orchestra.run.smithi143.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:24:56.288 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-05-08T10:24:56.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f9b0007c190 msgr2=0x7f9b0007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.163:6816/4102156474,v1:172.21.15.163:6817/4102156474] conn(0x7f9b0007c190 0x7f9b0007e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9b000762d0 msgr2=0x7f9b00078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.289 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f9b000762d0 0x7f9b00078790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c141ed0 tx=0x7f9b0c008040 comp rx=0 tx=0).stop 2024-05-08T10:24:56.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c068110 msgr2=0x7f9b1c1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 --2- 172.21.15.143:0/3421621318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c068110 0x7f9b1c1520d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9b180090b0 tx=0x7f9b180046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b22bb2640 1 -- 172.21.15.143:0/3421621318 reap_dead start 2024-05-08T10:24:56.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 shutdown_connections 2024-05-08T10:24:56.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 >> 172.21.15.143:0/3421621318 conn(0x7f9b1c0cf2a0 msgr2=0x7f9b1c15d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:56.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 shutdown_connections 2024-05-08T10:24:56.290 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.303+0000 7f9b24615640 1 -- 172.21.15.143:0/3421621318 wait complete. 2024-05-08T10:24:56.298 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T10:24:56.337 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:24:56.344 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:24:56.401 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.416+0000 7f6b5adaf640 1 Processor -- start 2024-05-08T10:24:56.402 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.416+0000 7f6b5adaf640 1 -- start start 2024-05-08T10:24:56.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b5adaf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6b540b8240 0x7f6b540d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b5adaf640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b540d2250 0x7f6b540d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b5adaf640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b540b8a60 con 0x7f6b5415f350 2024-05-08T10:24:56.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b5adaf640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6b540b9670 con 0x7f6b540b8240 2024-05-08T10:24:56.411 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b5adaf640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f6b540b8d40 con 0x7f6b540d2250 2024-05-08T10:24:56.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b53fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6b540b8240 0x7f6b540d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b53fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6b540b8240 0x7f6b540d3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39638/0 (socket says 172.21.15.143:39638) 2024-05-08T10:24:56.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b53fff640 1 -- 172.21.15.143:0/1500268972 learned_addr learned my addr 172.21.15.143:0/1500268972 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:56.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b53fff640 1 -- 172.21.15.143:0/1500268972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b540d2250 msgr2=0x7f6b540d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:56.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b53fff640 1 --2- 172.21.15.143:0/1500268972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b540d2250 0x7f6b540d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b53fff640 1 -- 172.21.15.143:0/1500268972 >> v1:172.21.15.163:6789/0 conn(0x7f6b5415f350 legacy=0x7f6b540bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:56.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.417+0000 7f6b53fff640 1 -- 172.21.15.143:0/1500268972 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b540b9020 con 0x7f6b540b8240 2024-05-08T10:24:56.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.418+0000 7f6b53fff640 1 --2- 172.21.15.143:0/1500268972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540b8240 0x7f6b540d3580 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009870 tx=0x7f6b4802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339bfd97bddcce2d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.418+0000 7f6b537fe640 1 -- 172.21.15.143:0/1500268972 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48037070 con 0x7f6b540b8240 2024-05-08T10:24:56.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.418+0000 7f6b537fe640 1 -- 172.21.15.143:0/1500268972 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b48032440 con 0x7f6b540b8240 2024-05-08T10:24:56.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.418+0000 7f6b537fe640 1 -- 172.21.15.143:0/1500268972 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48032810 con 0x7f6b540b8240 2024-05-08T10:24:56.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.419+0000 7f6b5adaf640 1 -- 172.21.15.143:0/1500268972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540b8240 msgr2=0x7f6b540d3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.419+0000 7f6b5adaf640 1 --2- 172.21.15.143:0/1500268972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540b8240 0x7f6b540d3580 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009870 tx=0x7f6b4802a250 comp rx=0 tx=0).stop 2024-05-08T10:24:56.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.419+0000 7f6b5adaf640 1 -- 172.21.15.143:0/1500268972 shutdown_connections 2024-05-08T10:24:56.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.419+0000 7f6b5adaf640 1 --2- 172.21.15.143:0/1500268972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b540d2250 0x7f6b540d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.419+0000 7f6b5adaf640 1 --2- 172.21.15.143:0/1500268972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540b8240 0x7f6b540d3580 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.419+0000 7f6b5adaf640 1 -- 172.21.15.143:0/1500268972 >> 172.21.15.143:0/1500268972 conn(0x7f6b54073e70 msgr2=0x7f6b54074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:56.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.419+0000 7f6b5adaf640 1 -- 172.21.15.143:0/1500268972 shutdown_connections 2024-05-08T10:24:56.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.419+0000 7f6b5adaf640 1 -- 172.21.15.143:0/1500268972 wait complete. 2024-05-08T10:24:56.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.420+0000 7f6b5adaf640 1 Processor -- start 2024-05-08T10:24:56.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.420+0000 7f6b5adaf640 1 -- start start 2024-05-08T10:24:56.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b5adaf640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b540b8240 0x7f6b54161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b5adaf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540d2250 0x7f6b5415fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b5adaf640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b5415f350 0x7f6b54160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b5adaf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5415f730 con 0x7f6b540d2250 2024-05-08T10:24:56.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b5adaf640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6b540d3ac0 con 0x7f6b5415f350 2024-05-08T10:24:56.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b5adaf640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f6b540b86a0 con 0x7f6b540b8240 2024-05-08T10:24:56.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b53fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540d2250 0x7f6b5415fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b53fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540d2250 0x7f6b5415fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39650/0 (socket says 172.21.15.143:39650) 2024-05-08T10:24:56.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b53fff640 1 -- 172.21.15.143:0/3603550649 learned_addr learned my addr 172.21.15.143:0/3603550649 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:56.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b58b4b640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b540b8240 0x7f6b54161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b5934c640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b5415f350 0x7f6b54160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b53fff640 1 -- 172.21.15.143:0/3603550649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b540b8240 msgr2=0x7f6b54161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.416 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b53fff640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b540b8240 0x7f6b54161ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b53fff640 1 -- 172.21.15.143:0/3603550649 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b5415f350 msgr2=0x7f6b54160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b53fff640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b5415f350 0x7f6b54160440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b53fff640 1 -- 172.21.15.143:0/3603550649 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b541601c0 con 0x7f6b540d2250 2024-05-08T10:24:56.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.421+0000 7f6b53fff640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540d2250 0x7f6b5415fc80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6b48000c00 tx=0x7f6b480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.422+0000 7f6b517fa640 1 -- 172.21.15.143:0/3603550649 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48041070 con 0x7f6b540d2250 2024-05-08T10:24:56.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.422+0000 7f6b517fa640 1 -- 172.21.15.143:0/3603550649 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4803c870 con 0x7f6b540d2250 2024-05-08T10:24:56.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.422+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b540ce9b0 con 0x7f6b540d2250 2024-05-08T10:24:56.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.422+0000 7f6b517fa640 1 -- 172.21.15.143:0/3603550649 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48037040 con 0x7f6b540d2250 2024-05-08T10:24:56.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.422+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b540cef70 con 0x7f6b540d2250 2024-05-08T10:24:56.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.423+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b540cf770 con 0x7f6b540d2250 2024-05-08T10:24:56.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.423+0000 7f6b517fa640 1 -- 172.21.15.143:0/3603550649 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b48044070 con 0x7f6b540d2250 2024-05-08T10:24:56.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.424+0000 7f6b517fa640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6b40076300 0x7f6b400787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.424+0000 7f6b517fa640 1 -- 172.21.15.143:0/3603550649 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f6b480b7d20 con 0x7f6b540d2250 2024-05-08T10:24:56.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.424+0000 7f6b58b4b640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6b40076300 0x7f6b400787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.424+0000 7f6b58b4b640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6b40076300 0x7f6b400787c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b540b4230 tx=0x7f6b44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.428+0000 7f6b517fa640 1 -- 172.21.15.143:0/3603550649 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6b48081a10 con 0x7f6b540d2250 2024-05-08T10:24:56.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.611+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6b5415d030 con 0x7f6b40076300 2024-05-08T10:24:56.596 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.611+0000 7f6b517fa640 1 -- 172.21.15.143:0/3603550649 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6b5415d030 con 0x7f6b40076300 2024-05-08T10:24:56.596 INFO:teuthology.orchestra.run.smithi143.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T10:24:56.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6b40076300 msgr2=0x7f6b400787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.598 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6b40076300 0x7f6b400787c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b540b4230 tx=0x7f6b44008040 comp rx=0 tx=0).stop 2024-05-08T10:24:56.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540d2250 msgr2=0x7f6b5415fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540d2250 0x7f6b5415fc80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6b48000c00 tx=0x7f6b480046c0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 shutdown_connections 2024-05-08T10:24:56.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b5415f350 0x7f6b54160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f6b40076300 0x7f6b400787c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b540d2250 0x7f6b5415fc80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 --2- 172.21.15.143:0/3603550649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b540b8240 0x7f6b54161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.599 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 >> 172.21.15.143:0/3603550649 conn(0x7f6b54073e70 msgr2=0x7f6b540d4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:56.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 shutdown_connections 2024-05-08T10:24:56.600 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.613+0000 7f6b5adaf640 1 -- 172.21.15.143:0/3603550649 wait complete. 2024-05-08T10:24:56.610 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:24:56.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.765+0000 7f128872b640 1 Processor -- start 2024-05-08T10:24:56.750 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.765+0000 7f128872b640 1 -- start start 2024-05-08T10:24:56.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.765+0000 7f128872b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 0x7f12800d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f128872b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1280074830 con 0x7f12800af310 2024-05-08T10:24:56.754 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f128872b640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1280073f90 con 0x7f12800ae180 2024-05-08T10:24:56.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f128872b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f1280074270 con 0x7f128015d130 2024-05-08T10:24:56.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f1286cc8640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f12800af310 0x7f128006edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:54336/0 (socket says 172.21.15.143:54336) 2024-05-08T10:24:56.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f1286cc8640 1 -- 172.21.15.143:0/2317173706 learned_addr learned my addr 172.21.15.143:0/2317173706 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-05-08T10:24:56.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12864c7640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 0x7f12800d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 <== mon.0 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493772297 0 0) 0x7f1280074830 con 0x7f12800af310 2024-05-08T10:24:56.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f126c003520 con 0x7f12800af310 2024-05-08T10:24:56.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457102625 0 0) 0x7f1280073f90 con 0x7f12800ae180 2024-05-08T10:24:56.755 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1280074830 con 0x7f12800ae180 2024-05-08T10:24:56.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 <== mon.0 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3354873224 0 0) 0x7f126c003520 con 0x7f12800af310 2024-05-08T10:24:56.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 msgr2=0x7f12800d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:56.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 0x7f12800d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 >> v1:172.21.15.163:6789/0 conn(0x7f12800ae180 legacy=0x7f12800aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1280074550 con 0x7f12800af310 2024-05-08T10:24:56.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 <== mon.0 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2981175186 0 0) 0x7f1278001a70 con 0x7f12800af310 2024-05-08T10:24:56.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12864c7640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 0x7f12800d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:24:56.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 >> v1:172.21.15.143:6789/0 conn(0x7f12800af310 legacy=0x7f128006edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.756 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f126c003c10 0x7f126c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 0x7f126c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f126c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1280074270 con 0x7f126c004d40 2024-05-08T10:24:56.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f126c00baf0 con 0x7f126c003c10 2024-05-08T10:24:56.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f126c00bcf0 con 0x7f128015d130 2024-05-08T10:24:56.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f1286cc8640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f126c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.766+0000 7f12864c7640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f126c003c10 0x7f126c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.757 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f1285cc6640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 0x7f126c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f1286cc8640 1 -- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 msgr2=0x7f126c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:56.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f1286cc8640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 0x7f126c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f1286cc8640 1 -- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f126c003c10 msgr2=0x7f126c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:24:56.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f1286cc8640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f126c003c10 0x7f126c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f1286cc8640 1 -- 172.21.15.143:0/2317173706 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c003520 con 0x7f126c004d40 2024-05-08T10:24:56.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f1285cc6640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f128015d130 0x7f126c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:24:56.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f1286cc8640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f126c0051c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f127800a7e0 tx=0x7f126c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799f5c9234717ed9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.758 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127800a430 con 0x7f126c004d40 2024-05-08T10:24:56.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127802f070 con 0x7f126c004d40 2024-05-08T10:24:56.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.767+0000 7f12854c5640 1 -- 172.21.15.143:0/2317173706 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127802bb70 con 0x7f126c004d40 2024-05-08T10:24:56.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.768+0000 7f128872b640 1 -- 172.21.15.143:0/2317173706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 msgr2=0x7f126c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.768+0000 7f128872b640 1 --2- 172.21.15.143:0/2317173706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f126c0051c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f127800a7e0 tx=0x7f126c005830 comp rx=0 tx=0).stop 2024-05-08T10:24:56.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.768+0000 7f1286cc8640 1 -- 172.21.15.143:0/2317173706 reap_dead start 2024-05-08T10:24:56.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.768+0000 7f128872b640 1 -- 172.21.15.143:0/2317173706 shutdown_connections 2024-05-08T10:24:56.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.768+0000 7f128872b640 1 -- 172.21.15.143:0/2317173706 >> 172.21.15.143:0/2317173706 conn(0x7f128006c500 msgr2=0x7f128006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:56.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.768+0000 7f128872b640 1 -- 172.21.15.143:0/2317173706 shutdown_connections 2024-05-08T10:24:56.759 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.768+0000 7f128872b640 1 -- 172.21.15.143:0/2317173706 wait complete. 2024-05-08T10:24:56.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.769+0000 7f128872b640 1 Processor -- start 2024-05-08T10:24:56.760 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.769+0000 7f128872b640 1 -- start start 2024-05-08T10:24:56.762 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f128872b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f12801e6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f128872b640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12801e3240 0x7f12801f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f128872b640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12801e36c0 0x7f128009d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f128872b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f12800d08a0 con 0x7f126c004d40 2024-05-08T10:24:56.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f128872b640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f12800d0720 con 0x7f12801e36c0 2024-05-08T10:24:56.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f128872b640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f12800d0a20 con 0x7f12801e3240 2024-05-08T10:24:56.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f12864c7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f12801e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f12864c7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f12801e6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:39668/0 (socket says 172.21.15.143:39668) 2024-05-08T10:24:56.763 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f12864c7640 1 -- 172.21.15.143:0/2417024387 learned_addr learned my addr 172.21.15.143:0/2417024387 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:24:56.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f1286cc8640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12801e36c0 0x7f128009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f1285cc6640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12801e3240 0x7f12801f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f12864c7640 1 -- 172.21.15.143:0/2417024387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12801e3240 msgr2=0x7f12801f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f12864c7640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12801e3240 0x7f12801f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f12864c7640 1 -- 172.21.15.143:0/2417024387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12801e36c0 msgr2=0x7f128009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f12864c7640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12801e36c0 0x7f128009d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.770+0000 7f12864c7640 1 -- 172.21.15.143:0/2417024387 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12801e51f0 con 0x7f126c004d40 2024-05-08T10:24:56.764 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.771+0000 7f12864c7640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f12801e6250 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f127c011960 tx=0x7f127c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.771+0000 7f1276ffd640 1 -- 172.21.15.143:0/2417024387 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c00faf0 con 0x7f126c004d40 2024-05-08T10:24:56.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.771+0000 7f1276ffd640 1 -- 172.21.15.143:0/2417024387 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127c00fc90 con 0x7f126c004d40 2024-05-08T10:24:56.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.771+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12801e5490 con 0x7f126c004d40 2024-05-08T10:24:56.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.771+0000 7f1276ffd640 1 -- 172.21.15.143:0/2417024387 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c004030 con 0x7f126c004d40 2024-05-08T10:24:56.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.771+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12801e5a50 con 0x7f126c004d40 2024-05-08T10:24:56.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.772+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128006a550 con 0x7f126c004d40 2024-05-08T10:24:56.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.772+0000 7f1276ffd640 1 -- 172.21.15.143:0/2417024387 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f127c012040 con 0x7f126c004d40 2024-05-08T10:24:56.765 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.773+0000 7f1276ffd640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1264076300 0x7f12640787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:24:56.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.773+0000 7f1285cc6640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1264076300 0x7f12640787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:24:56.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.773+0000 7f1276ffd640 1 -- 172.21.15.143:0/2417024387 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f127c0975e0 con 0x7f126c004d40 2024-05-08T10:24:56.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.773+0000 7f1285cc6640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1264076300 0x7f12640787c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12801e93a0 tx=0x7f1270009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:24:56.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.777+0000 7f1276ffd640 1 -- 172.21.15.143:0/2417024387 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f127c019070 con 0x7f126c004d40 2024-05-08T10:24:56.938 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.953+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1280072db0 con 0x7f1264076300 2024-05-08T10:24:56.939 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.954+0000 7f1276ffd640 1 -- 172.21.15.143:0/2417024387 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13442 (secure 0 0 0) 0x7f1280072db0 con 0x7f1264076300 2024-05-08T10:24:56.939 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:24:56.940 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:24:56.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1264076300 msgr2=0x7f12640787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1264076300 0x7f12640787c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12801e93a0 tx=0x7f1270009040 comp rx=0 tx=0).stop 2024-05-08T10:24:56.941 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 msgr2=0x7f12801e6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:24:56.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f12801e6250 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f127c011960 tx=0x7f127c011e20 comp rx=0 tx=0).stop 2024-05-08T10:24:56.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 shutdown_connections 2024-05-08T10:24:56.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12801e36c0 0x7f128009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f12801e3240 0x7f12801f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f1264076300 0x7f12640787c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 --2- 172.21.15.143:0/2417024387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f126c004d40 0x7f12801e6250 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:24:56.942 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 >> 172.21.15.143:0/2417024387 conn(0x7f128006c500 msgr2=0x7f12800b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:24:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 shutdown_connections 2024-05-08T10:24:56.943 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:24:56.956+0000 7f128872b640 1 -- 172.21.15.143:0/2417024387 wait complete. 2024-05-08T10:24:56.952 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-08T10:24:56.536732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220412,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754308,"statfs":{"total":773094113280,"available":772868411392,"internally_reserved":0,"allocated":4333568,"data_stored":2394936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.906787"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-08T10:24:48.643132+0000","last_change":"2024-05-08T10:23:44.272097+0000","last_active":"2024-05-08T10:24:48.643132+0000","last_peered":"2024-05-08T10:24:48.643132+0000","last_clean":"2024-05-08T10:24:48.643132+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:48.643132+0000","last_undegraded":"2024-05-08T10:24:48.643132+0000","last_fullsized":"2024-05-08T10:24:48.643132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:23:43.158265+0000","last_clean_scrub_stamp":"2024-05-08T10:23:43.158265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:49.514123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":987136,"data_stored":742143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":742143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:24:56.955 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T10:23:43.158265+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=10, tm_min=23, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=10, tm_min=24, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T10:24:56.955 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T10:25:16.956 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:25:17.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.083+0000 7feb7155f640 1 Processor -- start 2024-05-08T10:25:17.068 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.083+0000 7feb7155f640 1 -- start start 2024-05-08T10:25:17.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb7155f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feb6c0d0090 0x7feb6c0d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb7155f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 0x7feb6c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb7155f640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb6c160e30 con 0x7feb6c15dea0 2024-05-08T10:25:17.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb7155f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7feb6c161bf0 con 0x7feb6c0d0090 2024-05-08T10:25:17.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb7155f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7feb6c0d3d00 con 0x7feb6c0d38a0 2024-05-08T10:25:17.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb6affd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feb6c0d0090 0x7feb6c0d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb6affd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feb6c0d0090 0x7feb6c0d3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40640/0 (socket says 172.21.15.143:40640) 2024-05-08T10:25:17.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb6affd640 1 -- 172.21.15.143:0/4080832559 learned_addr learned my addr 172.21.15.143:0/4080832559 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:25:17.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb63fff640 1 --2- 172.21.15.143:0/4080832559 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 0x7feb6c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb6affd640 1 -- 172.21.15.143:0/4080832559 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 msgr2=0x7feb6c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:25:17.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb6affd640 1 --2- 172.21.15.143:0/4080832559 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 0x7feb6c15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.071 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb6affd640 1 -- 172.21.15.143:0/4080832559 >> v1:172.21.15.163:6789/0 conn(0x7feb6c15dea0 legacy=0x7feb6c0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb6affd640 1 -- 172.21.15.143:0/4080832559 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c161110 con 0x7feb6c0d0090 2024-05-08T10:25:17.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.084+0000 7feb63fff640 1 --2- 172.21.15.143:0/4080832559 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 0x7feb6c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:25:17.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.085+0000 7feb6affd640 1 --2- 172.21.15.143:0/4080832559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 0x7feb6c0d3360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009870 tx=0x7feb5c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b771922024b604e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:25:17.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.085+0000 7feb6a7fc640 1 -- 172.21.15.143:0/4080832559 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c037070 con 0x7feb6c0d0090 2024-05-08T10:25:17.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.085+0000 7feb6a7fc640 1 -- 172.21.15.143:0/4080832559 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c032440 con 0x7feb6c0d0090 2024-05-08T10:25:17.072 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.085+0000 7feb6a7fc640 1 -- 172.21.15.143:0/4080832559 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c032810 con 0x7feb6c0d0090 2024-05-08T10:25:17.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.086+0000 7feb7155f640 1 -- 172.21.15.143:0/4080832559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 msgr2=0x7feb6c0d3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.076 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.086+0000 7feb7155f640 1 --2- 172.21.15.143:0/4080832559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 0x7feb6c0d3360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009870 tx=0x7feb5c02a250 comp rx=0 tx=0).stop 2024-05-08T10:25:17.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.086+0000 7feb7155f640 1 -- 172.21.15.143:0/4080832559 shutdown_connections 2024-05-08T10:25:17.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.086+0000 7feb7155f640 1 --2- 172.21.15.143:0/4080832559 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 0x7feb6c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.086+0000 7feb7155f640 1 --2- 172.21.15.143:0/4080832559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 0x7feb6c0d3360 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.086+0000 7feb7155f640 1 -- 172.21.15.143:0/4080832559 >> 172.21.15.143:0/4080832559 conn(0x7feb6c0682f0 msgr2=0x7feb6c068700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:25:17.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.086+0000 7feb7155f640 1 -- 172.21.15.143:0/4080832559 shutdown_connections 2024-05-08T10:25:17.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.086+0000 7feb7155f640 1 -- 172.21.15.143:0/4080832559 wait complete. 2024-05-08T10:25:17.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.087+0000 7feb7155f640 1 Processor -- start 2024-05-08T10:25:17.077 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.087+0000 7feb7155f640 1 -- start start 2024-05-08T10:25:17.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb7155f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 0x7feb6c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb7155f640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 0x7feb6c13d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb7155f640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb6c15dea0 0x7feb6c1e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb7155f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c0d1a70 con 0x7feb6c0d0090 2024-05-08T10:25:17.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb7155f640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c1616d0 con 0x7feb6c15dea0 2024-05-08T10:25:17.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb7155f640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7feb6c0d1bf0 con 0x7feb6c0d38a0 2024-05-08T10:25:17.078 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 0x7feb6c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 0x7feb6c154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40650/0 (socket says 172.21.15.143:40650) 2024-05-08T10:25:17.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6affd640 1 -- 172.21.15.143:0/645020288 learned_addr learned my addr 172.21.15.143:0/645020288 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:25:17.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb63fff640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 0x7feb6c13d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6b7fe640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb6c15dea0 0x7feb6c1e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6affd640 1 -- 172.21.15.143:0/645020288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 msgr2=0x7feb6c13d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6affd640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 0x7feb6c13d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.079 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6affd640 1 -- 172.21.15.143:0/645020288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb6c15dea0 msgr2=0x7feb6c1e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6affd640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb6c15dea0 0x7feb6c1e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6affd640 1 -- 172.21.15.143:0/645020288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c1410a0 con 0x7feb6c0d0090 2024-05-08T10:25:17.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6b7fe640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb6c15dea0 0x7feb6c1e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:25:17.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb6affd640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 0x7feb6c154fb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feb5c000c00 tx=0x7feb5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:25:17.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.088+0000 7feb637fe640 1 -- 172.21.15.143:0/645020288 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c037040 con 0x7feb6c0d0090 2024-05-08T10:25:17.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.089+0000 7feb637fe640 1 -- 172.21.15.143:0/645020288 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c042070 con 0x7feb6c0d0090 2024-05-08T10:25:17.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.089+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6c141360 con 0x7feb6c0d0090 2024-05-08T10:25:17.080 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.089+0000 7feb637fe640 1 -- 172.21.15.143:0/645020288 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c030bd0 con 0x7feb6c0d0090 2024-05-08T10:25:17.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.089+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6c141a30 con 0x7feb6c0d0090 2024-05-08T10:25:17.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.090+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6c075dc0 con 0x7feb6c0d0090 2024-05-08T10:25:17.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.090+0000 7feb637fe640 1 -- 172.21.15.143:0/645020288 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feb5c047460 con 0x7feb6c0d0090 2024-05-08T10:25:17.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.091+0000 7feb637fe640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7feb4c076300 0x7feb4c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.091+0000 7feb63fff640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7feb4c076300 0x7feb4c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.091+0000 7feb637fe640 1 -- 172.21.15.143:0/645020288 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7feb5c0b7f00 con 0x7feb6c0d0090 2024-05-08T10:25:17.081 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.091+0000 7feb63fff640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7feb4c076300 0x7feb4c0787c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0b56e0 tx=0x7feb54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:25:17.082 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.095+0000 7feb637fe640 1 -- 172.21.15.143:0/645020288 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feb5c081b60 con 0x7feb6c0d0090 2024-05-08T10:25:17.266 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.281+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 --> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb6c06a550 con 0x7feb4c076300 2024-05-08T10:25:17.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.282+0000 7feb637fe640 1 -- 172.21.15.143:0/645020288 <== mgr.4107 v2:172.21.15.143:6832/2824092200 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13339 (secure 0 0 0) 0x7feb6c06a550 con 0x7feb4c076300 2024-05-08T10:25:17.267 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:25:17.267 INFO:teuthology.orchestra.run.smithi143.stderr:dumped all 2024-05-08T10:25:17.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7feb4c076300 msgr2=0x7feb4c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7feb4c076300 0x7feb4c0787c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0b56e0 tx=0x7feb54008040 comp rx=0 tx=0).stop 2024-05-08T10:25:17.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 msgr2=0x7feb6c154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 0x7feb6c154fb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feb5c000c00 tx=0x7feb5c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 shutdown_connections 2024-05-08T10:25:17.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb6c15dea0 0x7feb6c1e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb6c0d38a0 0x7feb6c13d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.270 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7feb4c076300 0x7feb4c0787c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 --2- 172.21.15.143:0/645020288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb6c0d0090 0x7feb6c154fb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 >> 172.21.15.143:0/645020288 conn(0x7feb6c0682f0 msgr2=0x7feb6c0b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:25:17.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 shutdown_connections 2024-05-08T10:25:17.271 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.284+0000 7feb7155f640 1 -- 172.21.15.143:0/645020288 wait complete. 2024-05-08T10:25:17.280 INFO:teuthology.orchestra.run.smithi143.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-05-08T10:25:16.540635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220400,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754320,"statfs":{"total":773094113280,"available":772868423680,"internally_reserved":0,"allocated":4333568,"data_stored":2394936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002276"},"pg_stats":[{"pgid":"1.0","version":"34'74","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-08T10:24:57.588077+0000","last_change":"2024-05-08T10:24:57.588119+0000","last_active":"2024-05-08T10:24:57.588077+0000","last_peered":"2024-05-08T10:24:57.588077+0000","last_clean":"2024-05-08T10:24:57.588077+0000","last_became_active":"2024-05-08T10:23:44.269291+0000","last_became_peered":"2024-05-08T10:23:44.269291+0000","last_unstale":"2024-05-08T10:24:57.588077+0000","last_undegraded":"2024-05-08T10:24:57.588077+0000","last_fullsized":"2024-05-08T10:24:57.588077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-05-08T10:24:57.587974+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-05-08T10:24:57.587974+0000","last_clean_scrub_stamp":"2024-05-08T10:24:57.587974+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:00:50.640848+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":987136,"data_stored":742143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":987136,"data_stored":742143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:25:17.281 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T10:25:17.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.399+0000 7f8ab6dc8640 1 Processor -- start 2024-05-08T10:25:17.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.399+0000 7f8ab6dc8640 1 -- start start 2024-05-08T10:25:17.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8ab6dc8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ab00d20d0 0x7f8ab00d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8ab6dc8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab0163250 0x7f8ab0163680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8ab6dc8640 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab0163f00 con 0x7f8ab015f5a0 2024-05-08T10:25:17.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8ab6dc8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab00cfe20 con 0x7f8ab00d20d0 2024-05-08T10:25:17.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8ab6dc8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00d0100 con 0x7f8ab0163250 2024-05-08T10:25:17.387 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8aaffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ab00d20d0 0x7f8ab00d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8aaffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ab00d20d0 0x7f8ab00d0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40666/0 (socket says 172.21.15.143:40666) 2024-05-08T10:25:17.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8aaffff640 1 -- 172.21.15.143:0/1614973881 learned_addr learned my addr 172.21.15.143:0/1614973881 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:25:17.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8ab5365640 1 --2- 172.21.15.143:0/1614973881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab0163250 0x7f8ab0163680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8aaffff640 1 -- 172.21.15.143:0/1614973881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab0163250 msgr2=0x7f8ab0163680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:25:17.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8aaffff640 1 --2- 172.21.15.143:0/1614973881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab0163250 0x7f8ab0163680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8aaffff640 1 -- 172.21.15.143:0/1614973881 >> v1:172.21.15.163:6789/0 conn(0x7f8ab015f5a0 legacy=0x7f8ab00d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:25:17.388 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8aaffff640 1 -- 172.21.15.143:0/1614973881 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00d03e0 con 0x7f8ab00d20d0 2024-05-08T10:25:17.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.400+0000 7f8ab5365640 1 --2- 172.21.15.143:0/1614973881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab0163250 0x7f8ab0163680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:25:17.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.401+0000 7f8aaffff640 1 --2- 172.21.15.143:0/1614973881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 0x7f8ab00d0900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00cf870 tx=0x7f8a9c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7955814653e03695 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:25:17.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.401+0000 7f8aaf7fe640 1 -- 172.21.15.143:0/1614973881 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c037070 con 0x7f8ab00d20d0 2024-05-08T10:25:17.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.401+0000 7f8aaf7fe640 1 -- 172.21.15.143:0/1614973881 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c032440 con 0x7f8ab00d20d0 2024-05-08T10:25:17.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.401+0000 7f8aaf7fe640 1 -- 172.21.15.143:0/1614973881 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c032810 con 0x7f8ab00d20d0 2024-05-08T10:25:17.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.402+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/1614973881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 msgr2=0x7f8ab00d0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.402+0000 7f8ab6dc8640 1 --2- 172.21.15.143:0/1614973881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 0x7f8ab00d0900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00cf870 tx=0x7f8a9c02a180 comp rx=0 tx=0).stop 2024-05-08T10:25:17.389 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.402+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/1614973881 shutdown_connections 2024-05-08T10:25:17.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.402+0000 7f8ab6dc8640 1 --2- 172.21.15.143:0/1614973881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab0163250 0x7f8ab0163680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.402+0000 7f8ab6dc8640 1 --2- 172.21.15.143:0/1614973881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 0x7f8ab00d0900 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.402+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/1614973881 >> 172.21.15.143:0/1614973881 conn(0x7f8ab0074080 msgr2=0x7f8ab006d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:25:17.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.402+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/1614973881 shutdown_connections 2024-05-08T10:25:17.390 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.402+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/1614973881 wait complete. 2024-05-08T10:25:17.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.403+0000 7f8ab6dc8640 1 Processor -- start 2024-05-08T10:25:17.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.403+0000 7f8ab6dc8640 1 -- start start 2024-05-08T10:25:17.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab6dc8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 0x7f8ab00c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab6dc8640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab015f5a0 0x7f8ab01f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.394 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab6dc8640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ab0163250 0x7f8ab01f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab6dc8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab015fb00 con 0x7f8ab00d20d0 2024-05-08T10:25:17.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab6dc8640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab015f980 con 0x7f8ab0163250 2024-05-08T10:25:17.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab6dc8640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00d38e0 con 0x7f8ab015f5a0 2024-05-08T10:25:17.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab4b64640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 0x7f8ab00c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab4b64640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 0x7f8ab00c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40672/0 (socket says 172.21.15.143:40672) 2024-05-08T10:25:17.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab4b64640 1 -- 172.21.15.143:0/2386055645 learned_addr learned my addr 172.21.15.143:0/2386055645 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:25:17.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8aaffff640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab015f5a0 0x7f8ab01f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.395 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab5365640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ab0163250 0x7f8ab01f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab4b64640 1 -- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab015f5a0 msgr2=0x7f8ab01f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab4b64640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab015f5a0 0x7f8ab01f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab4b64640 1 -- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ab0163250 msgr2=0x7f8ab01f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab4b64640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ab0163250 0x7f8ab01f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab4b64640 1 -- 172.21.15.143:0/2386055645 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00ca7d0 con 0x7f8ab00d20d0 2024-05-08T10:25:17.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8aaffff640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab015f5a0 0x7f8ab01f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:25:17.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab5365640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ab0163250 0x7f8ab01f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:25:17.396 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab4b64640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 0x7f8ab00c8dc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c460 tx=0x7f8aa400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:25:17.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8aad7fa640 1 -- 172.21.15.143:0/2386055645 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4016020 con 0x7f8ab00d20d0 2024-05-08T10:25:17.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8aad7fa640 1 -- 172.21.15.143:0/2386055645 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa4012870 con 0x7f8ab00d20d0 2024-05-08T10:25:17.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab00c9730 con 0x7f8ab00d20d0 2024-05-08T10:25:17.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.404+0000 7f8aad7fa640 1 -- 172.21.15.143:0/2386055645 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4012c60 con 0x7f8ab00d20d0 2024-05-08T10:25:17.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.405+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab00c9cf0 con 0x7f8ab00d20d0 2024-05-08T10:25:17.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.405+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab00d6200 con 0x7f8ab00d20d0 2024-05-08T10:25:17.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.406+0000 7f8aad7fa640 1 -- 172.21.15.143:0/2386055645 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8aa4019020 con 0x7f8ab00d20d0 2024-05-08T10:25:17.397 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.407+0000 7f8aad7fa640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8a94076300 0x7f8a940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.407+0000 7f8aad7fa640 1 -- 172.21.15.143:0/2386055645 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f8aa4096d10 con 0x7f8ab00d20d0 2024-05-08T10:25:17.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.407+0000 7f8aaffff640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8a94076300 0x7f8a940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.407+0000 7f8aaffff640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8a94076300 0x7f8a940787c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c034000 tx=0x7f8a9c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:25:17.398 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.411+0000 7f8aad7fa640 1 -- 172.21.15.143:0/2386055645 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ab00d6200 con 0x7f8ab00d20d0 2024-05-08T10:25:17.585 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.600+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f8ab00d4990 con 0x7f8ab00d20d0 2024-05-08T10:25:17.589 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.604+0000 7f8aad7fa640 1 -- 172.21.15.143:0/2386055645 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f8aa4020070 con 0x7f8ab00d20d0 2024-05-08T10:25:17.591 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.606+0000 7f8aad7fa640 1 -- 172.21.15.143:0/2386055645 <== mon.0 v2:172.21.15.143:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8aa405fd80 con 0x7f8ab00d20d0 2024-05-08T10:25:17.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8a94076300 msgr2=0x7f8a940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.592 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8a94076300 0x7f8a940787c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c034000 tx=0x7f8a9c02e000 comp rx=0 tx=0).stop 2024-05-08T10:25:17.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 msgr2=0x7f8ab00c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 0x7f8ab00c8dc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c460 tx=0x7f8aa400c920 comp rx=0 tx=0).stop 2024-05-08T10:25:17.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 shutdown_connections 2024-05-08T10:25:17.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ab0163250 0x7f8ab01f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ab015f5a0 0x7f8ab01f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f8a94076300 0x7f8a940787c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 --2- 172.21.15.143:0/2386055645 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00d20d0 0x7f8ab00c8dc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.593 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 >> 172.21.15.143:0/2386055645 conn(0x7f8ab0074080 msgr2=0x7f8ab00ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:25:17.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 shutdown_connections 2024-05-08T10:25:17.594 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.607+0000 7f8ab6dc8640 1 -- 172.21.15.143:0/2386055645 wait complete. 2024-05-08T10:25:17.604 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T10:25:17.605 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:25:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.722+0000 7f2fe8f14640 1 Processor -- start 2024-05-08T10:25:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.722+0000 7f2fe8f14640 1 -- start start 2024-05-08T10:25:17.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.723+0000 7f2fe8f14640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe415b8a0 0x7f2fe40725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.712 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.723+0000 7f2fe8f14640 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2fe40b54d0 0x7f2fe40b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.723+0000 7f2fe8f14640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2fe40b46e0 0x7f2fe406f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.723+0000 7f2fe8f14640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe40af910 con 0x7f2fe40b46e0 2024-05-08T10:25:17.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.723+0000 7f2fe8f14640 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe40b5140 con 0x7f2fe40b54d0 2024-05-08T10:25:17.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.723+0000 7f2fe8f14640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40b4b80 con 0x7f2fe415b8a0 2024-05-08T10:25:17.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe2d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2fe40b46e0 0x7f2fe406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.713 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe2d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2fe40b46e0 0x7f2fe406f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40680/0 (socket says 172.21.15.143:40680) 2024-05-08T10:25:17.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe2d9d640 1 -- 172.21.15.143:0/3370570764 learned_addr learned my addr 172.21.15.143:0/3370570764 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:25:17.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe1d9b640 1 --2- 172.21.15.143:0/3370570764 >> v2:172.21.15.163:3300/0 conn(0x7f2fe40b54d0 0x7f2fe40b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe259c640 1 --2- 172.21.15.143:0/3370570764 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe415b8a0 0x7f2fe40725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe2d9d640 1 -- 172.21.15.143:0/3370570764 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe415b8a0 msgr2=0x7f2fe40725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:25:17.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe2d9d640 1 --2- 172.21.15.143:0/3370570764 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe415b8a0 0x7f2fe40725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe2d9d640 1 -- 172.21.15.143:0/3370570764 >> v2:172.21.15.163:3300/0 conn(0x7f2fe40b54d0 msgr2=0x7f2fe40b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:25:17.714 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe2d9d640 1 --2- 172.21.15.143:0/3370570764 >> v2:172.21.15.163:3300/0 conn(0x7f2fe40b54d0 0x7f2fe40b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe2d9d640 1 -- 172.21.15.143:0/3370570764 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40b4e60 con 0x7f2fe40b46e0 2024-05-08T10:25:17.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe259c640 1 --2- 172.21.15.143:0/3370570764 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe415b8a0 0x7f2fe40725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:25:17.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.724+0000 7f2fe1d9b640 1 --2- 172.21.15.143:0/3370570764 >> v2:172.21.15.163:3300/0 conn(0x7f2fe40b54d0 0x7f2fe40b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:25:17.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.725+0000 7f2fe2d9d640 1 --2- 172.21.15.143:0/3370570764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b46e0 0x7f2fe406f090 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40b3f40 tx=0x7f2fdc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b90ff0cea9b84f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:25:17.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.725+0000 7f2fe159a640 1 -- 172.21.15.143:0/3370570764 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc036070 con 0x7f2fe40b46e0 2024-05-08T10:25:17.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.725+0000 7f2fe159a640 1 -- 172.21.15.143:0/3370570764 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2fdc031600 con 0x7f2fe40b46e0 2024-05-08T10:25:17.715 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.725+0000 7f2fe159a640 1 -- 172.21.15.143:0/3370570764 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0319f0 con 0x7f2fe40b46e0 2024-05-08T10:25:17.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.726+0000 7f2fe8f14640 1 -- 172.21.15.143:0/3370570764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b46e0 msgr2=0x7f2fe406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.726+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/3370570764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b46e0 0x7f2fe406f090 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40b3f40 tx=0x7f2fdc02a6a0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.726+0000 7f2fe8f14640 1 -- 172.21.15.143:0/3370570764 shutdown_connections 2024-05-08T10:25:17.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.726+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/3370570764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b46e0 0x7f2fe406f090 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.726+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/3370570764 >> v2:172.21.15.163:3300/0 conn(0x7f2fe40b54d0 0x7f2fe40b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.716 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.726+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/3370570764 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe415b8a0 0x7f2fe40725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.726+0000 7f2fe8f14640 1 -- 172.21.15.143:0/3370570764 >> 172.21.15.143:0/3370570764 conn(0x7f2fe406c500 msgr2=0x7f2fe406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:25:17.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.726+0000 7f2fe8f14640 1 -- 172.21.15.143:0/3370570764 shutdown_connections 2024-05-08T10:25:17.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.726+0000 7f2fe8f14640 1 -- 172.21.15.143:0/3370570764 wait complete. 2024-05-08T10:25:17.717 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.727+0000 7f2fe8f14640 1 Processor -- start 2024-05-08T10:25:17.718 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.727+0000 7f2fe8f14640 1 -- start start 2024-05-08T10:25:17.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.728+0000 7f2fe8f14640 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe40b46e0 0x7f2fe41f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.728+0000 7f2fe8f14640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b54d0 0x7f2fe40b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.728+0000 7f2fe8f14640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fe415b8a0 0x7f2fe40b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.721 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.728+0000 7f2fe8f14640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4072c60 con 0x7f2fe40b54d0 2024-05-08T10:25:17.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.728+0000 7f2fe8f14640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4072ae0 con 0x7f2fe415b8a0 2024-05-08T10:25:17.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.728+0000 7f2fe8f14640 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe406f5d0 con 0x7f2fe40b46e0 2024-05-08T10:25:17.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.728+0000 7f2fe1d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b54d0 0x7f2fe40b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.728+0000 7f2fe1d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b54d0 0x7f2fe40b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40690/0 (socket says 172.21.15.143:40690) 2024-05-08T10:25:17.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.728+0000 7f2fe1d9b640 1 -- 172.21.15.143:0/666746542 learned_addr learned my addr 172.21.15.143:0/666746542 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-05-08T10:25:17.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe259c640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe40b46e0 0x7f2fe41f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe1d9b640 1 -- 172.21.15.143:0/666746542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe40b46e0 msgr2=0x7f2fe41f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.722 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe1d9b640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe40b46e0 0x7f2fe41f7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe2d9d640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fe415b8a0 0x7f2fe40b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe1d9b640 1 -- 172.21.15.143:0/666746542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fe415b8a0 msgr2=0x7f2fe40b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe1d9b640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fe415b8a0 0x7f2fe40b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe1d9b640 1 -- 172.21.15.143:0/666746542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe4152ae0 con 0x7f2fe40b54d0 2024-05-08T10:25:17.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe1d9b640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b54d0 0x7f2fe40b30b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800e840 tx=0x7f2fd800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:25:17.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fd2ffd640 1 -- 172.21.15.143:0/666746542 <== mon.0 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd800f040 con 0x7f2fe40b54d0 2024-05-08T10:25:17.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fd2ffd640 1 -- 172.21.15.143:0/666746542 <== mon.0 v2:172.21.15.143:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2fd8004030 con 0x7f2fe40b54d0 2024-05-08T10:25:17.723 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fd2ffd640 1 -- 172.21.15.143:0/666746542 <== mon.0 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8004420 con 0x7f2fe40b54d0 2024-05-08T10:25:17.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe4152dc0 con 0x7f2fe40b54d0 2024-05-08T10:25:17.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.729+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe4153380 con 0x7f2fe40b54d0 2024-05-08T10:25:17.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.730+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe406a550 con 0x7f2fe40b54d0 2024-05-08T10:25:17.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.731+0000 7f2fd2ffd640 1 -- 172.21.15.143:0/666746542 <== mon.0 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2fd800c6d0 con 0x7f2fe40b54d0 2024-05-08T10:25:17.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.731+0000 7f2fd2ffd640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2fc4076300 0x7f2fc40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:25:17.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.731+0000 7f2fe259c640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2fc4076300 0x7f2fc40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:25:17.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.731+0000 7f2fd2ffd640 1 -- 172.21.15.143:0/666746542 <== mon.0 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f2fd8097040 con 0x7f2fe40b54d0 2024-05-08T10:25:17.724 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.732+0000 7f2fe259c640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2fc4076300 0x7f2fc40787c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40096d0 tx=0x7f2fd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:25:17.725 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.736+0000 7f2fd2ffd640 1 -- 172.21.15.143:0/666746542 <== mon.0 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2fd8017020 con 0x7f2fe40b54d0 2024-05-08T10:25:17.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.964+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fe406ca80 con 0x7f2fe40b54d0 2024-05-08T10:25:17.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.964+0000 7f2fd2ffd640 1 -- 172.21.15.143:0/666746542 <== mon.0 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3875 (secure 0 0 0) 0x7f2fd8060c10 con 0x7f2fe40b54d0 2024-05-08T10:25:17.949 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-05-08T10:25:17.950 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2519238209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2519238209},{"type":"v1","addr":"172.21.15.163:6834","nonce":2519238209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4520,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/420423244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":420423244},{"type":"v1","addr":"172.21.15.163:6835","nonce":420423244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4794,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2143046617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2143046617},{"type":"v1","addr":"172.21.15.143:6836","nonce":2143046617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/843250147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":843250147},{"type":"v1","addr":"172.21.15.143:6837","nonce":843250147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[]} 2024-05-08T10:25:17.950 INFO:teuthology.orchestra.run.smithi143.stderr:dumped fsmap epoch 17 2024-05-08T10:25:17.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2fc4076300 msgr2=0x7f2fc40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2fc4076300 0x7f2fc40787c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40096d0 tx=0x7f2fd4008040 comp rx=0 tx=0).stop 2024-05-08T10:25:17.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b54d0 msgr2=0x7f2fe40b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:25:17.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b54d0 0x7f2fe40b30b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800e840 tx=0x7f2fd800ed00 comp rx=0 tx=0).stop 2024-05-08T10:25:17.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 shutdown_connections 2024-05-08T10:25:17.952 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2fe415b8a0 0x7f2fe40b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:6832/2824092200,v1:172.21.15.143:6833/2824092200] conn(0x7f2fc4076300 0x7f2fc40787c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe40b54d0 0x7f2fe40b30b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 --2- 172.21.15.143:0/666746542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2fe40b46e0 0x7f2fe41f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:25:17.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.966+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 >> 172.21.15.143:0/666746542 conn(0x7f2fe406c500 msgr2=0x7f2fe40afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:25:17.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.967+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 shutdown_connections 2024-05-08T10:25:17.953 INFO:teuthology.orchestra.run.smithi143.stderr:2024-05-08T10:25:17.967+0000 7f2fe8f14640 1 -- 172.21.15.143:0/666746542 wait complete. 2024-05-08T10:25:17.963 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-08T10:25:17.963 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T10:25:17.963 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T10:25:17.963 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:17.972 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T10:25:17.973 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T10:25:17.973 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.022 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T10:25:18.023 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T10:25:18.023 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.035 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T10:25:18.035 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T10:25:18.035 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.087 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T10:25:18.087 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T10:25:18.088 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T10:25:18.088 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.126 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T10:25:18.126 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T10:25:18.126 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.197 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T10:25:18.197 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T10:25:18.197 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.279 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T10:25:18.280 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T10:25:18.280 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-05-08T10:25:18.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-05-08T10:25:18.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-08T10:25:18.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-08T10:25:18.319 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T10:25:18.319 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T10:25:18.319 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.353 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T10:25:18.354 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T10:25:18.354 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.437 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T10:25:18.438 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T10:25:18.438 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.473 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T10:25:18.473 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T10:25:18.473 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.548 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T10:25:18.548 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T10:25:18.549 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T10:25:18.549 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.576 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T10:25:18.576 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T10:25:18.576 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.617 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T10:25:18.617 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T10:25:18.617 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T10:25:18.618 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.628 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T10:25:18.629 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T10:25:18.629 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.669 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T10:25:18.670 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T10:25:18.670 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:25:18.722 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T10:25:18.723 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T10:25:18.723 DEBUG:teuthology.orchestra.run.smithi143:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-08T10:25:18.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:25:18.756 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T10:25:18.953 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:25:18.954 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T10:25:19.042 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:25:19.042 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T10:25:19.109 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:25:19.109 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T10:25:19.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:25:19.159 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T10:25:19.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:25:19.323 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T10:25:19.379 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:25:19.379 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T10:25:19.436 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:25:19.436 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T10:25:19.486 INFO:tasks.ceph:Archiving mon data... 2024-05-08T10:25:19.488 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/data/mon.a.tgz 2024-05-08T10:25:19.488 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-05-08T10:25:19.504 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.NVIT3otYLW 2024-05-08T10:25:19.504 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NVIT3otYLW 2024-05-08T10:25:19.628 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.NVIT3otYLW 2024-05-08T10:25:19.712 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.NVIT3otYLW is 271KB 2024-05-08T10:25:19.807 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.NVIT3otYLW 2024-05-08T10:25:19.822 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/data/mon.b.tgz 2024-05-08T10:25:19.823 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-05-08T10:25:19.839 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.TGvk6pk0rh 2024-05-08T10:25:19.840 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TGvk6pk0rh 2024-05-08T10:25:19.985 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.TGvk6pk0rh 2024-05-08T10:25:20.068 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.TGvk6pk0rh is 371KB 2024-05-08T10:25:20.168 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.TGvk6pk0rh 2024-05-08T10:25:20.183 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/data/mon.c.tgz 2024-05-08T10:25:20.184 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-05-08T10:25:20.238 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.PV5LDWsis6 2024-05-08T10:25:20.239 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PV5LDWsis6 2024-05-08T10:25:20.369 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.PV5LDWsis6 2024-05-08T10:25:20.454 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.PV5LDWsis6 is 371KB 2024-05-08T10:25:20.550 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.PV5LDWsis6 2024-05-08T10:25:20.565 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T10:25:20.565 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T10:25:20.568 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T10:25:20.651 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T10:25:20.686 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T10:25:20.686 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T10:25:20.687 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/remote/smithi143/crash 2024-05-08T10:25:20.688 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T10:25:20.719 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/remote/smithi163/crash 2024-05-08T10:25:20.720 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T10:25:20.750 INFO:tasks.ceph:Shutting down logrotate 2024-05-08T10:25:20.750 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:25:20.764 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:25:20.867 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T10:25:20.894 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T10:25:20.919 INFO:tasks.ceph:Compressing logs... 2024-05-08T10:25:20.919 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T10:25:20.936 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T10:25:21.009 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T10:25:21.009 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T10:25:21.010 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35567.log 2024-05-08T10:25:21.010 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-08T10:25:21.010 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.35567.log: 91.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T10:25:21.010 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-08T10:25:21.010 INFO:teuthology.orchestra.run.smithi163.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35567.log.gz 2024-05-08T10:25:21.010 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-08T10:25:21.010 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-08T10:25:21.011 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.5.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T10:25:21.011 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35476.log 2024-05-08T10:25:21.011 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.4.log: 91.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-08T10:25:21.011 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-08T10:25:21.011 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41383.log 2024-05-08T10:25:21.011 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.35476.log: /var/log/ceph/ceph-mgr.x.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35476.log.gz 2024-05-08T10:25:21.011 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-08T10:25:21.011 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.1.41383.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-08T10:25:21.011 INFO:teuthology.orchestra.run.smithi163.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41383.log.gz 2024-05-08T10:25:21.012 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35520.log 2024-05-08T10:25:21.012 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35687.log 2024-05-08T10:25:21.012 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.35520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41781.log 2024-05-08T10:25:21.012 INFO:teuthology.orchestra.run.smithi163.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35520.log.gz 2024-05-08T10:25:21.012 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.35687.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35687.log.gz 2024-05-08T10:25:21.012 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35396.log 2024-05-08T10:25:21.012 INFO:teuthology.orchestra.run.smithi163.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T10:25:21.012 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.3.41781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41781.log.gz 2024-05-08T10:25:21.013 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35607.log 2024-05-08T10:25:21.013 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.35396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35647.log 2024-05-08T10:25:21.013 INFO:teuthology.orchestra.run.smithi163.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35396.log.gz/var/log/ceph/ceph-client.admin.35607.log: 2024-05-08T10:25:21.013 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35436.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35607.log.gz 2024-05-08T10:25:21.013 INFO:teuthology.orchestra.run.smithi163.stderr: 2024-05-08T10:25:21.013 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.35647.log: gzip -5 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35647.log.gz 2024-05-08T10:25:21.013 INFO:teuthology.orchestra.run.smithi163.stderr: --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-08T10:25:21.013 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.35436.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-08T10:25:21.014 INFO:teuthology.orchestra.run.smithi163.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35436.log.gz/var/log/ceph/ceph-mds.d.log: 2024-05-08T10:25:21.014 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mon.b.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-08T10:25:21.047 INFO:teuthology.orchestra.run.smithi163.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-08T10:25:21.049 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46046.log 2024-05-08T10:25:21.049 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47466.log 2024-05-08T10:25:21.049 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44623.log 2024-05-08T10:25:21.049 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47466.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46046.log.gz 2024-05-08T10:25:21.049 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46512.log 2024-05-08T10:25:21.050 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47466.log.gz 2024-05-08T10:25:21.050 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45468.log 2024-05-08T10:25:21.050 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46512.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.44623.log.gz --verbose 2024-05-08T10:25:21.050 INFO:teuthology.orchestra.run.smithi143.stderr: -- /var/log/ceph/ceph-client.admin.43295.log 2024-05-08T10:25:21.050 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45468.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46512.log.gz 2024-05-08T10:25:21.050 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44072.log 2024-05-08T10:25:21.050 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45468.log.gz 2024-05-08T10:25:21.050 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35323.log 2024-05-08T10:25:21.051 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.2.44072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42320.log 2024-05-08T10:25:21.051 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43295.log.gz 2024-05-08T10:25:21.051 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44072.log.gz 2024-05-08T10:25:21.051 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.35323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48928.log 2024-05-08T10:25:21.051 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42320.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35323.log.gz 2024-05-08T10:25:21.051 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42327.log 2024-05-08T10:25:21.051 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48928.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42320.log.gz 2024-05-08T10:25:21.051 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43115.log 2024-05-08T10:25:21.052 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42327.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48928.log.gz 2024-05-08T10:25:21.052 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2024-05-08T10:25:21.052 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42327.log.gz 2024-05-08T10:25:21.052 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41245.log 2024-05-08T10:25:21.052 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47688.log 2024-05-08T10:25:21.052 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43115.log.gz 2024-05-08T10:25:21.052 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41245.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2024-05-08T10:25:21.052 INFO:teuthology.orchestra.run.smithi143.stderr: /var/log/ceph/ceph-client.admin.41992.log 2024-05-08T10:25:21.053 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41245.log.gz 2024-05-08T10:25:21.053 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48718.log 2024-05-08T10:25:21.053 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41992.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47688.log.gz 2024-05-08T10:25:21.053 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45805.log 2024-05-08T10:25:21.053 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48718.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41992.log.gz 2024-05-08T10:25:21.053 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45763.log 2024-05-08T10:25:21.053 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48718.log.gz 2024-05-08T10:25:21.053 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41417.log 2024-05-08T10:25:21.054 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45805.log: /var/log/ceph/ceph-client.admin.45763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43633.log 2024-05-08T10:25:21.054 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45805.log.gz 2024-05-08T10:25:21.054 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41417.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.45763.log.gz --verbose 2024-05-08T10:25:21.054 INFO:teuthology.orchestra.run.smithi143.stderr: -- /var/log/ceph/ceph-client.admin.45078.log 2024-05-08T10:25:21.054 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41417.log.gz 2024-05-08T10:25:21.054 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.43633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41203.log 2024-05-08T10:25:21.054 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43633.log.gz 2024-05-08T10:25:21.054 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45078.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T10:25:21.055 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45078.log.gz 2024-05-08T10:25:21.055 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47119.log 2024-05-08T10:25:21.055 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48844.log 2024-05-08T10:25:21.055 INFO:teuthology.orchestra.run.smithi143.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41203.log.gz 2024-05-08T10:25:21.055 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42661.log 2024-05-08T10:25:21.055 INFO:teuthology.orchestra.run.smithi143.stderr: 83.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T10:25:21.055 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42313.log 2024-05-08T10:25:21.055 INFO:teuthology.orchestra.run.smithi143.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47119.log.gz 2024-05-08T10:25:21.056 INFO:teuthology.orchestra.run.smithi143.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48844.log.gz 2024-05-08T10:25:21.056 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44374.log 2024-05-08T10:25:21.056 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42661.log.gz/var/log/ceph/ceph-client.admin.42313.log: 2024-05-08T10:25:21.056 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44332.log 2024-05-08T10:25:21.056 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42313.log.gz 2024-05-08T10:25:21.056 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44290.log 2024-05-08T10:25:21.056 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44374.log.gz 2024-05-08T10:25:21.056 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-08T10:25:21.056 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44332.log: /var/log/ceph/ceph-client.admin.44290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46808.log 2024-05-08T10:25:21.057 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44332.log.gz 2024-05-08T10:25:21.057 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44290.log.gz 2024-05-08T10:25:21.057 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose --/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.47218.log 2024-05-08T10:25:21.057 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.0.46808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44910.log 2024-05-08T10:25:21.057 INFO:teuthology.orchestra.run.smithi143.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46808.log.gz 2024-05-08T10:25:21.057 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49205.log 2024-05-08T10:25:21.057 INFO:teuthology.orchestra.run.smithi143.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47218.log.gz 2024-05-08T10:25:21.057 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42662.log 2024-05-08T10:25:21.058 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44910.log.gz 2024-05-08T10:25:21.058 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43157.log 2024-05-08T10:25:21.058 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6%/var/log/ceph/ceph-client.admin.42662.log: -- replaced with /var/log/ceph/ceph-client.admin.49205.log.gz 2024-05-08T10:25:21.058 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45867.log 2024-05-08T10:25:21.058 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42662.log.gz 2024-05-08T10:25:21.058 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45595.log 2024-05-08T10:25:21.058 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42989.log 2024-05-08T10:25:21.059 INFO:teuthology.orchestra.run.smithi143.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45867.log.gz 2024-05-08T10:25:21.059 INFO:teuthology.orchestra.run.smithi143.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43157.log.gz 2024-05-08T10:25:21.059 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46987.log 2024-05-08T10:25:21.059 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45595.log.gz 2024-05-08T10:25:21.059 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42527.log 2024-05-08T10:25:21.059 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42989.log: gzip/var/log/ceph/ceph-client.admin.46987.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T10:25:21.059 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42989.log.gz 2024-05-08T10:25:21.059 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42527.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46987.log.gz 2024-05-08T10:25:21.060 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49072.log 2024-05-08T10:25:21.060 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42527.log.gz 2024-05-08T10:25:21.060 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45036.log 2024-05-08T10:25:21.060 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2024-05-08T10:25:21.060 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45036.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49072.log.gz 2024-05-08T10:25:21.060 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T10:25:21.060 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45036.log.gz 2024-05-08T10:25:21.060 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T10:25:21.060 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48760.log 2024-05-08T10:25:21.061 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46004.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41108.log 2024-05-08T10:25:21.061 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2024-05-08T10:25:21.061 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44952.log 2024-05-08T10:25:21.061 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41108.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48760.log.gz 2024-05-08T10:25:21.061 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42905.log 2024-05-08T10:25:21.061 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41108.log.gz 2024-05-08T10:25:21.061 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44701.log 2024-05-08T10:25:21.062 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44952.log: /var/log/ceph/ceph-client.admin.42905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46620.log 2024-05-08T10:25:21.062 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44952.log.gz 2024-05-08T10:25:21.062 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44701.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42905.log.gz 2024-05-08T10:25:21.062 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2024-05-08T10:25:21.062 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44701.log.gz 2024-05-08T10:25:21.062 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47561.log 2024-05-08T10:25:21.062 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46620.log: /var/log/ceph/ceph-client.admin.45510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2024-05-08T10:25:21.062 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46620.log.gz 2024-05-08T10:25:21.063 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47561.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2024-05-08T10:25:21.063 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-08T10:25:21.063 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47561.log.gz 2024-05-08T10:25:21.063 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40835.log 2024-05-08T10:25:21.063 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45162.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42331.log 2024-05-08T10:25:21.063 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2024-05-08T10:25:21.063 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.40835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44248.log 2024-05-08T10:25:21.063 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40835.log.gz 2024-05-08T10:25:21.064 INFO:teuthology.orchestra.run.smithi143.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-08T10:25:21.064 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45387.log 2024-05-08T10:25:21.064 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T10:25:21.064 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44248.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42331.log.gz 2024-05-08T10:25:21.064 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45387.log: /var/log/ceph/ceph-mgr.y.log 2024-05-08T10:25:21.064 INFO:teuthology.orchestra.run.smithi143.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44248.log.gz 2024-05-08T10:25:21.064 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47898.log 2024-05-08T10:25:21.064 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45387.log.gz 2024-05-08T10:25:21.065 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42947.log 2024-05-08T10:25:21.065 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45222.log 2024-05-08T10:25:21.065 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42947.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.47898.log.gz --verbose 2024-05-08T10:25:21.065 INFO:teuthology.orchestra.run.smithi143.stderr: -- /var/log/ceph/ceph-client.admin.48024.log 2024-05-08T10:25:21.065 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45222.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42947.log.gz 2024-05-08T10:25:21.065 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T10:25:21.065 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48024.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45222.log.gz 2024-05-08T10:25:21.065 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41994.log 2024-05-08T10:25:21.066 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48024.log.gz 2024-05-08T10:25:21.066 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-05-08T10:25:21.066 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46134.log 2024-05-08T10:25:21.066 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44868.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41994.log.gz 2024-05-08T10:25:21.066 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47982.log 2024-05-08T10:25:21.066 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-05-08T10:25:21.066 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45552.log 2024-05-08T10:25:21.066 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42667.log 2024-05-08T10:25:21.067 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46134.log.gz 2024-05-08T10:25:21.067 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45552.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47982.log.gz 2024-05-08T10:25:21.067 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48214.log 2024-05-08T10:25:21.067 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45552.log.gz 2024-05-08T10:25:21.067 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5/var/log/ceph/ceph-client.admin.42667.log: --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2024-05-08T10:25:21.067 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47255.log 2024-05-08T10:25:21.067 INFO:teuthology.orchestra.run.smithi143.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42667.log.gz 2024-05-08T10:25:21.067 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48214.log.gz 2024-05-08T10:25:21.068 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41627.log 2024-05-08T10:25:21.068 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41985.log 2024-05-08T10:25:21.068 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2024-05-08T10:25:21.068 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41627.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47255.log.gz 2024-05-08T10:25:21.068 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T10:25:21.068 INFO:teuthology.orchestra.run.smithi143.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41627.log.gz 2024-05-08T10:25:21.068 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5/var/log/ceph/ceph-client.admin.41985.log: --verbose -- /var/log/ceph/ceph-client.admin.45911.log 2024-05-08T10:25:21.068 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mon.a.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41985.log.gz 2024-05-08T10:25:21.069 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48466.log 2024-05-08T10:25:21.069 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45911.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45911.log.gz 2024-05-08T10:25:21.069 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46092.log 2024-05-08T10:25:21.069 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48508.log 2024-05-08T10:25:21.069 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46092.log: /var/log/ceph/ceph-client.admin.48466.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48466.log.gz 2024-05-08T10:25:21.069 INFO:teuthology.orchestra.run.smithi143.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46092.log.gz 2024-05-08T10:25:21.069 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47175.log 2024-05-08T10:25:21.069 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48256.log 2024-05-08T10:25:21.069 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48508.log: /var/log/ceph/ceph-client.admin.47175.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48508.log.gz 2024-05-08T10:25:21.070 INFO:teuthology.orchestra.run.smithi143.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47175.log.gz 2024-05-08T10:25:21.070 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46302.log 2024-05-08T10:25:21.070 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48256.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48256.log.gz 2024-05-08T10:25:21.070 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45962.log 2024-05-08T10:25:21.070 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42324.log 2024-05-08T10:25:21.070 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46302.log: /var/log/ceph/ceph-client.admin.45962.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46302.log.gz 2024-05-08T10:25:21.070 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45962.log.gz 2024-05-08T10:25:21.070 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45679.log 2024-05-08T10:25:21.071 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42324.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42324.log.gz 2024-05-08T10:25:21.071 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41585.log 2024-05-08T10:25:21.071 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45307.log 2024-05-08T10:25:21.071 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45679.log: /var/log/ceph/ceph-client.admin.41585.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45679.log.gz 2024-05-08T10:25:21.071 INFO:teuthology.orchestra.run.smithi143.stderr: 89.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46554.log 2024-05-08T10:25:21.071 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41585.log.gz 2024-05-08T10:25:21.071 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45307.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45307.log.gz 2024-05-08T10:25:21.071 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35687.log 2024-05-08T10:25:21.072 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41333.log 2024-05-08T10:25:21.072 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46554.log: /var/log/ceph/ceph-client.admin.35687.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35687.log.gz 2024-05-08T10:25:21.072 INFO:teuthology.orchestra.run.smithi143.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46554.log.gz 2024-05-08T10:25:21.072 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46470.log 2024-05-08T10:25:21.072 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47646.log 2024-05-08T10:25:21.072 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41333.log: /var/log/ceph/ceph-client.admin.46470.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41333.log.gz 2024-05-08T10:25:21.072 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46470.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47292.log 2024-05-08T10:25:21.072 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-05-08T10:25:21.073 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47646.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47646.log.gz 2024-05-08T10:25:21.073 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47364.log 2024-05-08T10:25:21.073 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42666.log 2024-05-08T10:25:21.073 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47292.log: /var/log/ceph/ceph-client.admin.47364.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47292.log.gz 2024-05-08T10:25:21.073 INFO:teuthology.orchestra.run.smithi143.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47364.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49012.log 2024-05-08T10:25:21.073 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-05-08T10:25:21.073 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42666.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42666.log.gz 2024-05-08T10:25:21.073 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41995.log 2024-05-08T10:25:21.073 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40737.log 2024-05-08T10:25:21.074 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49012.log: /var/log/ceph/ceph-client.admin.41995.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49012.log.gz 2024-05-08T10:25:21.074 INFO:teuthology.orchestra.run.smithi143.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43768.log 2024-05-08T10:25:21.074 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41995.log.gz 2024-05-08T10:25:21.074 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.40737.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40737.log.gz 2024-05-08T10:25:21.074 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42664.log 2024-05-08T10:25:21.074 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41501.log 2024-05-08T10:25:21.074 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.43768.log: /var/log/ceph/ceph-client.admin.42664.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43768.log.gz 2024-05-08T10:25:21.074 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42329.log 2024-05-08T10:25:21.075 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42664.log.gz 2024-05-08T10:25:21.075 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41501.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41501.log.gz 2024-05-08T10:25:21.075 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41543.log 2024-05-08T10:25:21.075 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49114.log 2024-05-08T10:25:21.075 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42329.log: /var/log/ceph/ceph-client.admin.41543.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42329.log.gz 2024-05-08T10:25:21.075 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45120.log 2024-05-08T10:25:21.075 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41543.log.gz 2024-05-08T10:25:21.075 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.49114.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49114.log.gz 2024-05-08T10:25:21.076 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48592.log 2024-05-08T10:25:21.076 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48424.log 2024-05-08T10:25:21.076 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45120.log: /var/log/ceph/ceph-client.admin.48592.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45120.log.gz 2024-05-08T10:25:21.076 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47082.log 2024-05-08T10:25:21.076 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48592.log.gz 2024-05-08T10:25:21.076 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48424.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48424.log.gz 2024-05-08T10:25:21.076 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48550.log 2024-05-08T10:25:21.076 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41459.log 2024-05-08T10:25:21.077 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47082.log: /var/log/ceph/ceph-client.admin.48550.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47082.log.gz 2024-05-08T10:25:21.077 INFO:teuthology.orchestra.run.smithi143.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48550.log.gz 2024-05-08T10:25:21.077 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2024-05-08T10:25:21.077 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48676.log 2024-05-08T10:25:21.077 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41459.log: /var/log/ceph/ceph-client.admin.42328.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41459.log.gz 2024-05-08T10:25:21.077 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42863.log 2024-05-08T10:25:21.077 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-05-08T10:25:21.077 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48676.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48676.log.gz 2024-05-08T10:25:21.077 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41669.log 2024-05-08T10:25:21.078 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47856.log 2024-05-08T10:25:21.078 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42863.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz/var/log/ceph/ceph-client.admin.41669.log: 2024-05-08T10:25:21.078 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42863.log.gz 2024-05-08T10:25:21.078 INFO:teuthology.orchestra.run.smithi143.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41669.log.gz 2024-05-08T10:25:21.078 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44791.log 2024-05-08T10:25:21.078 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44417.log 2024-05-08T10:25:21.078 INFO:teuthology.orchestra.run.smithi143.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47856.log.gz 2024-05-08T10:25:21.078 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41152.log 2024-05-08T10:25:21.079 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44791.log.gz 2024-05-08T10:25:21.079 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43073.log 2024-05-08T10:25:21.079 INFO:teuthology.orchestra.run.smithi143.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44417.log.gz 2024-05-08T10:25:21.079 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45265.log 2024-05-08T10:25:21.079 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41152.log: /var/log/ceph/ceph-client.admin.43073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47940.log 2024-05-08T10:25:21.079 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45265.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43073.log.gz 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41152.log.gz 2024-05-08T10:25:21.079 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-05-08T10:25:21.079 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45265.log.gz 2024-05-08T10:25:21.080 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46344.log 2024-05-08T10:25:21.080 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46260.log 2024-05-08T10:25:21.080 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47940.log: /var/log/ceph/ceph-client.admin.46344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42658.log 2024-05-08T10:25:21.080 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46260.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47940.log.gz 2024-05-08T10:25:21.080 INFO:teuthology.orchestra.run.smithi143.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46344.log.gz 2024-05-08T10:25:21.080 INFO:teuthology.orchestra.run.smithi143.stderr:gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46260.log.gz 2024-05-08T10:25:21.080 INFO:teuthology.orchestra.run.smithi143.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44512.log 2024-05-08T10:25:21.080 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42658.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.40980.log 2024-05-08T10:25:21.081 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42658.log.gz 2024-05-08T10:25:21.081 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48802.log 2024-05-08T10:25:21.081 INFO:teuthology.orchestra.run.smithi143.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44512.log.gz 2024-05-08T10:25:21.081 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.40980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48886.log 2024-05-08T10:25:21.081 INFO:teuthology.orchestra.run.smithi143.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40980.log.gz 2024-05-08T10:25:21.081 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41064.log 2024-05-08T10:25:21.081 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48802.log: /var/log/ceph/ceph-client.admin.48886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48634.log 2024-05-08T10:25:21.081 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41064.log: 87.8% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48802.log.gz 2024-05-08T10:25:21.082 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48886.log.gz 2024-05-08T10:25:21.082 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.47604.log 2024-05-08T10:25:21.082 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41064.log.gz 2024-05-08T10:25:21.082 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.48634.log: -- /var/log/ceph/ceph-client.admin.41022.log 2024-05-08T10:25:21.082 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47604.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48634.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49155.log 2024-05-08T10:25:21.082 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-05-08T10:25:21.082 INFO:teuthology.orchestra.run.smithi143.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47604.log.gz 2024-05-08T10:25:21.082 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47387.log 2024-05-08T10:25:21.082 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41022.log: /var/log/ceph/ceph-client.admin.49155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2024-05-08T10:25:21.083 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7%/var/log/ceph/ceph-client.admin.47387.log: -- replaced with /var/log/ceph/ceph-client.admin.41022.log.gz 2024-05-08T10:25:21.083 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2024-05-08T10:25:21.083 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-08T10:25:21.083 INFO:teuthology.orchestra.run.smithi143.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.47387.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41771.log 2024-05-08T10:25:21.083 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-05-08T10:25:21.083 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46218.log: /var/log/ceph/ceph-mds.a.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2024-05-08T10:25:21.083 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47045.log 2024-05-08T10:25:21.084 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2024-05-08T10:25:21.084 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41771.log: /var/log/ceph/ceph-client.admin.47045.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41771.log.gz 2024-05-08T10:25:21.084 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41990.log 2024-05-08T10:25:21.084 INFO:teuthology.orchestra.run.smithi143.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.47045.log.gz 2024-05-08T10:25:21.084 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48382.log 2024-05-08T10:25:21.084 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41990.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2024-05-08T10:25:21.084 INFO:teuthology.orchestra.run.smithi143.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41990.log.gz 2024-05-08T10:25:21.084 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44459.log 2024-05-08T10:25:21.084 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47730.log 2024-05-08T10:25:21.085 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48382.log: /var/log/ceph/ceph-client.admin.44459.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48382.log.gz 2024-05-08T10:25:21.085 INFO:teuthology.orchestra.run.smithi143.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44459.log.gz 2024-05-08T10:25:21.085 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29292.log 2024-05-08T10:25:21.085 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42330.log 2024-05-08T10:25:21.085 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.tmp-client.admin.29292.log: /var/log/ceph/ceph-client.admin.47730.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29292.log.gz 2024-05-08T10:25:21.085 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47730.log.gz 2024-05-08T10:25:21.085 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41993.log 2024-05-08T10:25:21.085 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41729.log 2024-05-08T10:25:21.086 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42330.log.gz 2024-05-08T10:25:21.086 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41993.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41993.log.gz 2024-05-08T10:25:21.086 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41375.log 2024-05-08T10:25:21.086 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46176.log 2024-05-08T10:25:21.086 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41729.log: /var/log/ceph/ceph-client.admin.41375.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41729.log.gz 2024-05-08T10:25:21.086 INFO:teuthology.orchestra.run.smithi143.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48298.log 2024-05-08T10:25:21.086 INFO:teuthology.orchestra.run.smithi143.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41375.log.gz 2024-05-08T10:25:21.086 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.46176.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46176.log.gz 2024-05-08T10:25:21.087 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41813.log 2024-05-08T10:25:21.087 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48340.log 2024-05-08T10:25:21.087 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48298.log: /var/log/ceph/ceph-client.admin.41813.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48298.log.gz 2024-05-08T10:25:21.087 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41813.log.gz 2024-05-08T10:25:21.087 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2024-05-08T10:25:21.087 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48340.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48340.log.gz 2024-05-08T10:25:21.087 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41987.log 2024-05-08T10:25:21.087 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41287.log 2024-05-08T10:25:21.088 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.45721.log: /var/log/ceph/ceph-client.admin.41987.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2024-05-08T10:25:21.088 INFO:teuthology.orchestra.run.smithi143.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41987.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2024-05-08T10:25:21.088 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-05-08T10:25:21.088 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41287.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41287.log.gz 2024-05-08T10:25:21.088 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47772.log 2024-05-08T10:25:21.088 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47814.log 2024-05-08T10:25:21.088 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.42665.log: /var/log/ceph/ceph-client.admin.47772.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2024-05-08T10:25:21.088 INFO:teuthology.orchestra.run.smithi143.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47772.log.gz 2024-05-08T10:25:21.089 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35584.log 2024-05-08T10:25:21.089 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.47814.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47814.log.gz 2024-05-08T10:25:21.089 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45637.log 2024-05-08T10:25:21.089 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41989.log 2024-05-08T10:25:21.089 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.35584.log: /var/log/ceph/ceph-client.admin.45637.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35584.log.gz 2024-05-08T10:25:21.089 INFO:teuthology.orchestra.run.smithi143.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45637.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44206.log 2024-05-08T10:25:21.089 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-05-08T10:25:21.089 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.41989.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41989.log.gz 2024-05-08T10:25:21.090 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2024-05-08T10:25:21.090 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48970.log 2024-05-08T10:25:21.090 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.44206.log: /var/log/ceph/ceph-client.admin.46428.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44206.log.gz 2024-05-08T10:25:21.090 INFO:teuthology.orchestra.run.smithi143.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2024-05-08T10:25:21.090 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.48970.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48970.log.gz 2024-05-08T10:25:21.091 INFO:teuthology.orchestra.run.smithi143.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T10:25:21.091 INFO:teuthology.orchestra.run.smithi163.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-08T10:25:21.091 INFO:teuthology.orchestra.run.smithi163.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-08T10:25:21.103 INFO:teuthology.orchestra.run.smithi163.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-08T10:25:21.106 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-08T10:25:21.110 INFO:teuthology.orchestra.run.smithi143.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T10:25:21.116 INFO:teuthology.orchestra.run.smithi163.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-08T10:25:21.118 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T10:25:21.132 INFO:teuthology.orchestra.run.smithi143.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T10:25:21.132 INFO:teuthology.orchestra.run.smithi163.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-08T10:25:21.133 INFO:teuthology.orchestra.run.smithi163.stderr: 2024-05-08T10:25:21.134 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m0.155s 2024-05-08T10:25:21.134 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m0.595s 2024-05-08T10:25:21.134 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m0.047s 2024-05-08T10:25:21.135 INFO:teuthology.orchestra.run.smithi143.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T10:25:21.137 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-05-08T10:25:21.137 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m0.188s 2024-05-08T10:25:21.138 INFO:teuthology.orchestra.run.smithi143.stderr:user 0m0.832s 2024-05-08T10:25:21.138 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m0.151s 2024-05-08T10:25:21.138 INFO:tasks.ceph:Archiving logs... 2024-05-08T10:25:21.138 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/remote/smithi143/log 2024-05-08T10:25:21.139 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T10:25:21.431 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/remote/smithi163/log 2024-05-08T10:25:21.432 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T10:25:21.544 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T10:25:21.557 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T10:25:21.558 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T10:25:21.560 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T10:25:21.639 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T10:25:21.649 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T10:25:21.649 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T10:25:21.652 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T10:25:21.664 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-05-08T10:25:21.666 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-05-08T10:25:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T10:25:21.668 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-05-08T10:25:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:^* hv01.front.sepia.ceph.com 3 6 177 60 -1409us[-1443us] +/- 57ms 2024-05-08T10:25:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 60 +1733us[+1733us] +/- 58ms 2024-05-08T10:25:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 59 -374us[ -374us] +/- 81ms 2024-05-08T10:25:21.669 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:25:21.671 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T10:25:21.671 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-05-08T10:25:21.671 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv01.front.sepia.ceph.com 3 6 177 59 -1410us[-1411us] +/- 57ms 2024-05-08T10:25:21.671 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 60 +1722us[+1721us] +/- 58ms 2024-05-08T10:25:21.671 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 61 -397us[ -397us] +/- 81ms 2024-05-08T10:25:21.671 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:25:21.672 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T10:25:21.681 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T10:25:21.682 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T10:25:21.692 DEBUG:teuthology.orchestra.run.smithi143:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T10:25:21.775 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T10:25:21.836 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T10:25:21.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:25:21.864 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T10:25:21.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:25:21.893 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T10:25:21.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T10:25:21.914 INFO:teuthology.task.internal:Duration was 500.253207 seconds 2024-05-08T10:25:21.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T10:25:21.924 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T10:25:21.925 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T10:25:21.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T10:25:21.966 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T10:25:21.971 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T10:25:22.162 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T10:25:22.162 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-05-08T10:25:22.163 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T10:25:22.223 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2024-05-08T10:25:22.224 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T10:25:22.251 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T10:25:22.251 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T10:25:22.266 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T10:25:22.318 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T10:25:22.318 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T10:25:22.333 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T10:25:22.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T10:25:22.467 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T10:25:22.467 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T10:25:22.493 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T10:25:22.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T10:25:22.529 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T10:25:22.536 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T10:25:22.557 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-05-08T10:25:22.582 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2024-05-08T10:25:22.595 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T10:25:22.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:25:22.625 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T10:25:22.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:25:22.650 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T10:25:22.660 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T10:25:22.661 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/remote/smithi143 2024-05-08T10:25:22.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T10:25:22.699 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400/remote/smithi163 2024-05-08T10:25:22.699 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T10:25:22.732 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T10:25:22.733 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T10:25:22.736 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T10:25:22.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T10:25:22.797 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T10:25:22.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T10:25:22.832 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T10:25:22.832 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T10:25:22.835 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T10:25:22.847 INFO:teuthology.orchestra.run.smithi143.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 10:25 /home/ubuntu/cephtest 2024-05-08T10:25:22.850 INFO:teuthology.orchestra.run.smithi163.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 10:25 /home/ubuntu/cephtest 2024-05-08T10:25:22.851 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T10:25:22.862 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T10:25:22.882 INFO:teuthology.nuke:Checking targets against current locks 2024-05-08T10:25:22.914 DEBUG:teuthology.nuke:shortname: smithi143 2024-05-08T10:25:22.914 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T10:25:22.938 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 10:07:11.519233', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWJ+hlvCU+RQbiB8D6Z1ZWGpb72LvgWYaQjhbEZDtpE7a7pRiDDzNH8grax0hvyIE62BmUzBe/CEppoYCNoSeM='} 2024-05-08T10:25:22.942 DEBUG:teuthology.nuke:shortname: smithi163 2024-05-08T10:25:22.942 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T10:25:22.964 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-08_10:01:15-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7697400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 10:07:11.521082', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdRH89PE8AUm+BKZpFPskz3c4EU7ry/ujdoPhzopSXLxvYCUpu/Sa8LOD1f4/eaGfFZdzoFdexE5wuWK8cEA2k='} 2024-05-08T10:25:22.999 INFO:teuthology.orchestra.console.smithi143:Power off 2024-05-08T10:25:23.000 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-08T10:25:23.023 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2024-05-08T10:25:23.024 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T10:25:23.040 INFO:teuthology.orchestra.console.smithi163:Power off 2024-05-08T10:25:23.040 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-08T10:25:23.050 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-05-08T10:25:23.062 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-05-08T10:25:23.063 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T10:25:23.085 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-05-08T10:25:23.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-05-08T10:25:23.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-05-08T10:25:23.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-08T10:25:23.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-08T10:25:27.051 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T10:25:27.087 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T10:25:27.163 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-05-08T10:25:27.198 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-05-08T10:25:31.167 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T10:25:31.198 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T10:25:31.278 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-05-08T10:25:31.307 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-05-08T10:25:35.282 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T10:25:35.308 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T10:25:35.392 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-05-08T10:25:35.419 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-05-08T10:25:35.494 INFO:teuthology.orchestra.console.smithi143:Power off completed 2024-05-08T10:25:35.520 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-05-08T10:25:35.625 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} duration: 500.25320744514465 failure_reason: 'Test failure: test_flush (tasks.cephfs.test_flush.TestFlush)' flavor: default owner: scheduled_jcollin@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c1e89243815047ddb2885ffa728a3b5b status: fail success: false 2024-05-08T10:25:35.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T10:25:35.702 INFO:teuthology.run:FAIL